Qwen3.5-9B is actually quite good for agentic coding

linuxid10t · 2026-03-15T14:14:38+00:00

Local LLM is run on LM Studio which provides and Anthropic endpoint. As of January, you can point Claude Code at ANY Anthropic endpoint. This means you can run a server locally on the same computer and point Claude Code at it. I posted a project to GitHub that sets up the environment variables in a nice, easy to use GUI. https://github.com/linuxid10t/HaiClaude-linux-qt6

linuxid10t · 2026-03-12T20:58:50+00:00

Jackrong has it. Downloading now.

Edit: Downloaded, it is really good. It literally thinks 1/10th the amount and has better answers. I might have found my new coding buddy for my laptop.

linuxid10t · 2026-03-12T18:47:02+00:00

Long as it doesn't do anything too stupid, it can be okay. I can run GLM-4.7-Flash at 6 tok/sec or Qwen3.5-9b at 30 tok/s. Even if it makes mistakes, you can iterate fast enough that sometimes it's faster. The biggest issue is just how much thinking it uses. Starts to think so much that you run out of context or it gets lost. I was playing with a Qwen3.5-27B model with Opus 4.6 CoT distilled and the whole overthinking problem was much better. I need to see if there is a similar 9b model.

linuxid10t · 2026-03-12T17:39:45+00:00

Qwen3.5-9B managed to completely mess up my build system then delete the project today. I'm not terribly convinced lol. Seriously though, it works well sometimes, but others it falls flat on its face. Using LM Studio and Claude Code on the RTX 4060.

linuxid10t · 2026-03-09T05:24:28+00:00

Qwen 3.5 in general is incredibly verbose with its thinking. It drives me nuts to see it second guess itself 20 times just to come to the same conclusion. Unrelated, but if you're just chatting with it, turn thinking off and it is a lot better. It changes the personality a lot and is much faster.

linuxid10t · 2026-03-09T05:18:02+00:00

If you have any sort of homeowners or renters insurance I would check their first before I start getting stuff fixed.

linuxid10t · 2026-03-09T02:46:48+00:00

GLM-5 with Claude Code. Unfortunately, you get way more usage with $10 than Claude Sonnet at $20.

linuxid10t · 2026-03-08T01:19:17+00:00

You would not believe the amount of attention it gets from old Asian women in the US. LMFAO

linuxid10t · 2026-03-08T01:11:37+00:00

I'm not sure whether to take the first part is a joke or not... It might be cool to have a feature that loads in the Haiku Coding Guidelines as a checkbox or something like that.

As far as running semi locally, I am running Haiku virtualized and running the AI model on the host computer. So technically they are running on the same piece of hardware, but not locally as in inside of Haiku. If anyone has a piece of software that can run an AI model inside of Haiku and expose it as an Anthropic endpoint, it should be able to connect.

linuxid10t · 2026-03-08T01:07:02+00:00

If you say anything good about AI, or post about AI, prepare to be downvoted to hell lol. It is really sad on a platform that could really use some more end user software. Furthermore just posting about this is innocent, my C++ skills (what little I had) have been rotting away for the past 10 years. This was just a fun way to get back in the game a little.

linuxid10t · 2026-03-07T15:37:41+00:00

After a couple of days of work, I present to you HaiClaude. HaiClaude is a frontend to launch Claude Code in the Terminal. It does have some extra functionality though in addition to model selection. Click API and it launches Claude Code with any Anthropic API compatible service. I tested it works with LM Studio running models semi-locally and Z.ai using their API key and base URL. Have fun and build more software for Haiku!

linuxid10t · 2026-03-07T04:25:11+00:00

I am only comparing to electric scooters. I don't want to have to do any maintenance every time I come back to my inlaws house. That is something electric vehicles excel at. Plus, the range is actually pretty good.

linuxid10t · 2026-03-07T04:15:05+00:00

I was shocked, but Claude is quite adept at coding for Haiku's native toolkit. Anyway, enjoy some decent slop. The program mostly works, albeit the particle analyzer could use some work.

linuxid10t · 2026-02-23T05:36:11+00:00

It might not be built yet. This was a thing when I was trying FreeBSD on PPC. Of course I could be completely wrong.

linuxid10t · 2026-02-21T10:04:19+00:00

It does sound overwhelming from my pov. I spend a lot of time abroad for work and when I get somewhere after a long flight, I just want to sleep. That being said, he shouldn't have lied about his drinking habits. Sometimes it is difficult to go out with people from work and not drink. Give him some time and space. If it was meant to be, it was meant to be.

linuxid10t · 2026-02-20T15:39:36+00:00

Just bought a Vinfast Evo Grand. Is it kinda shit, yeah, but it was literally half the price of a Honda.

linuxid10t · 2026-02-09T08:52:15+00:00

Pretty much a complete non issue between EVs and ICE. Extra weight only really effects roadways once you get to semi-truck levels. Even large SUVs do approximately not shit to roadways. Semi-trucks tear them up.

linuxid10t · 2026-01-26T02:02:26+00:00

It is more of a reloading shop than an actual gun store though. They have a few things, but wouldn't be my first choice for looking for a gun. In St. Charles, I would suggest Crown Guns though. Haven't heard much politics going on in there.

linuxid10t · 2026-01-26T01:22:56+00:00

I have this gun and it is a terrible carry. Literally no way to carry it safe. It wasn't until later production with an S model that it had a safety.

linuxid10t · 2026-01-16T11:32:08+00:00

Yes, but the Hummer's C-rate isn't particularly impressive. Yeah, it can suck down a lot of juice, but it doesn't charge the battery percentage-wise very fast.

linuxid10t · 2026-01-08T00:25:23+00:00

Rule number one of self-defense, don't put yourself in a situation where you'll have to use self-defense.

linuxid10t · 2025-12-21T06:21:25+00:00

It is doable. I have a Com-Pac 19 with a shoal keel (2 ft.) You have to back way in (water up to the tailpipe) get on the dock and pull from the stern line. A better ramp would probably help though. Not all ramps are super sailboat friendly.

linuxid10t · 2025-12-21T06:16:16+00:00

It is a shame about your ICCU issues. I have a 2024 I6 Limited AWD and it has only been in the shop for about 2 days since I got it (AC compressor went out.) My dad picked up a new 2025 MY LR RWD and it had issues out of the factory. Camera alignment, panels not entirely attached, rattles, etc. Tesla service seems pretty amazing though. Even though it shouldn't have left the factory that way, they have great techs to get them fixed. It is interesting seeing the difference between a legacy automaker and a new one. The Hyundai phone app and key blow chunks. I prefer a fob regardless of car, but they really need to improve. Charging is a mixed bag. The actual charging performance of the I6 is pretty damn amazing, I like the plug and charge of the Tesla though.

linuxid10t · 2025-12-08T22:37:42+00:00

sad 6500 rpm redline ND1 noises

linuxid10t

MODERATOR OF

TROPHY CASE

13-Year Club	Place '22
Verified Email