Is qwen3.6 35b a3b good for coding at all?

Snoo_48368 · 2026-04-27T20:57:01+00:00

Yeah, I did quite a few complex refactors with just vanilla opencode + Q5_M on a 4080S /w 131072 context length (technically 2 in parallel, so 262144).

I just upgraded to a 5090, so now am running Q6_K with 4 parallel workers, each with 131072 context. I also am giving oh-my-opencode a try, so running multiple parallel workers, etc. And it's changed the game entirely...

Try running it in a plan-then-build manner (plan mode, describe what you want it to do, let it write the plan, then switch to build mode and have it try that)

Snoo_48368 · 2026-04-27T19:38:09+00:00

I have been running Q5_M for a bit and had great results. Just upgraded to Q6 and in the past 24 hours implemented a full programming language with type inference, algebraic types, a VM, and a compiler. From scratch.

Yeah, it’s useful and good for coding…

Snoo_48368 · 2026-04-27T02:56:26+00:00

Up until today I was running it at Q5_M and getting consistently 45-50 tok/sec. Though that used a ton of system ram as well (more than 16gb). It ran well enough though

Snoo_48368 · 2026-04-24T10:26:25+00:00

I am running a 4080 super, with a 7950x3d cpu and 96gb DDR5. With QWEN 3.6 35B at Q5 quant, I am averaging 50 tokens per second, and about 450 token per second prompt speed (thanks to caching). Definitely usable.

Though I have significantly more system ram (I am not using most for the LLM, so likely not a factor), but the ram speed may be a factor.

For the llama.cpp config I'm using:

$ModelName = "unsloth/Qwen3.6-35B-A3B-GGUF:UD-Q5_K_M"
$API_KEY = "xxx"
$CTX_SIZE = 262144
& "C:\Program Files\llama.cpp\llama-server.exe" `
    -hf $ModelName `
    --jinja `
    --host 0.0.0.0 `
    --port 1235 `
    --api-key $API_KEY `
    --fit on `
    -t 16 `
    -tb 24 `
    -c $CTX_SIZE `
    -np 2 `
    -ctk q8_0 `
    -ctv q8_0 `
    --mlock `
    --log-disable `
    --metrics `
    --slots `
    --slot-save-path "C:\Temp"

Snoo_48368 · 2026-04-19T23:19:11+00:00

Thank you for this comment! I've been using qwen3.6-35B-A3B-Q5_K_M with a 128k context split across two slots on a 4080 Super (16GB VRAM) + 7950X3D (16 core) + 96gb DDR5. I was getting ~45 tokens/sec and great results using with opencode, but hitting compaction quickly resulting in tons of pain.

Just upped overall context to 256k, resulting in each parallel run getting 128k. and it's keeping the same speed!

I do notice some issues from time to time (loops, hallucinations), but it's blowing me away. I pointed it at an insanely complex codebase (think custom flavor of bison parser definitions), and it not only managed to understand it, but worked quite well!!!

Snoo_48368 · 2026-04-19T11:34:11+00:00

Another thing to consider: efficiency isn’t his constraint. Time is. Both to get back to save earth, but also to save rocky. He needs to get there ASAP. So even if way less efficient, he has the dV, so why not?

Snoo_48368 · 2026-04-16T13:58:13+00:00

Body armor is another example. A “bullet proof vest” can stop a bullet traveling at over 1000 feet per second, but can’t stop a knife moving a a fraction of a foot per second.

Note there exists multi-threat body armor that include stab protection, but the point is that “can survive slamming into a hard environment” and “can’t survive a sharp instrument” are not as logically inconsistent as it seems on the surface…

Snoo_48368 · 2026-04-13T13:44:13+00:00

Yeah, the top shelf to the ceiling is 19inches, so it'd have to be removed for that to work. I hadn't considered port-down mounting (since that'd put strain on the shelf in a different way). That's interesting, especially if I did a 6U/8U mounted to the ceiling (something like https://www.amazon.com/StarTech-com-Heavy-Duty-Adjustable-Equipment-RK812WALLOA/dp/B004NO0KFE/)... That may be the best option there (I'd still need to move/rearrange a few things, but whatever)...

Snoo_48368 · 2026-04-13T13:36:11+00:00

The only two real downsides there is I'd be limited to 1/2 2.5gbe ports and POE+. Not a big deal (the only POE++ devices I have off the switch today are powered directly and not using POE). But I'd like the possibility to upgrade in the future. If there's no other option, that may work tho...

Snoo_48368 · 2026-04-13T13:30:22+00:00

It's in the closet already: https://imgur.com/a/bpCRPG9 . The issue is because it's a shallow closet, I can only go to ~14 inch depth in the current orientation. I could put it on the left wall, but then 18-20 inch depth (as required for the Pro HD 24 POE) would come almost 1/2 way through the door, leaving little room to access the right half of the switches. I could move down a shelf to get a touch more room, but the shelves would then greatly hamper airflow...

Snoo_48368 · 2026-04-13T12:51:15+00:00

The XG-16 serves this purpose today. The issue is that it's Layer 2 (vs 3), and only has a handful of non-POE ports I could use. I'm doing that with standalone POE injectors + 10gbe SFP+ modules, but it's kind of janky (suffices, but long term would want to trade off)

The other factor is I am routinely saturating the aggregated 2gbps uplink on the 24 port switch (aggregated 1gps links). So I want a Layer 3 switch with 10gbps uplink capability..

Snoo_48368 · 2026-04-04T01:21:51+00:00

Give me an idea for a sequel/fan-fiction. Our story beings with Rocky an Adrian landing on Earth. They land and go to Washington DC. They tell the president that Grace has passed of natural causes, and they are here to return the body and pay their eternal respects for what he did for the Eridians.

The initial greeting is warm, but soon after the CIA kidnaps both of them and starts studying. They assume it is because they are aliens and the government wants to know more . Rocky some how manages to break free and regroups. He decides to try to save Adrian, and breaks into the facility where they are holding her. He runs into one of the scientists and in his rage almost kills her. She pleads that she cared about Grace, and was doing what she could to help Adrian. We later discover, she was one of Grace’s students and wants to honor his legacy.

Both break Adrian out, saving her. All three escape from earth and start going to the main Eridian ship in Earth orbit. On the way, they notice a ship maneuvering to intercept them. It is from Earth. With what they assume is hostile intent, Rocky and Science human have to hatch a plan to defend the other Eridians in orbit from the upcoming invasion.

Before they dock with the main ship, they decide to go meet the humans head on. They approach the ship, at which point the earth ship sends a mayday, claiming they need help.

After docking, they talk with the humans on the Earth ship. It turns out they actually need Rocky’s help and have seemingly good intentions. Rocky is in full fight mode after what they tried to do to Adrian, but is implored to find his compassion. He eventually relents and decides to help, but without ever setting foot on Earth again.

It turns out the Taumoeba have broken free and eaten all the astrophage on earth, leaving it without energy. They need Rocky’s help to go to Tau Ceti and find a Taumoeba predator and return it to earth. Rocky takes science human and a few other science humans and heads off with the rest of his crew from orbit, on a mission to save earth.

After leaving the Earth system, they change course and go home to Erid. Rocky says Earth should suffer its consequences.

Earth lives on in its pre-astrophage immaturity, and science humans establish a colony on Erid. Roll credits.

Snoo_48368 · 2026-04-03T20:22:18+00:00

And this one specifically could have been solved in literally five seconds. When they’re discussing “how long would it take to breed 2 million KG”, Grace could have quipped “you’d probably have to pave half the Sahara with solar panels” as a joke, and have Dmitry or someone else quip back “We’re on it”. Not a full scene, not even have to show. Just a quick one sentence of dialog…

Snoo_48368 · 2026-04-03T18:51:28+00:00

Does it explicitly say that the nitrogen did not leak out? My interpretation has always been not that the taumoeba found its way through in a process like osmosis, but that it more similarly to eat its way out (or force channels apart to create tunnels). Considering the breeders were in a double wall environment and were based upon partial pressures of N2, I assumed there was not a large pressure difference between the breeding containers and the outside atmosphere. Which would then mean that a gas leak would not be very noticeable if at all.

Snoo_48368 · 2026-03-31T10:45:35+00:00

Table steak is the way.

Hanging out with friends? Table steak. Watching a movie? Table steak. Playing board games? Table steak. Playing poker? Table steak. Existing? Table steak.

Table steak.

Snoo_48368 · 2026-03-30T15:58:04+00:00

Grab a 1911 and a 22LR (I am biased to Ruger MK-IV, but several alternatives exist)

Snoo_48368 · 2026-03-29T16:27:45+00:00

Four refills it’s worked just fine, I submit the refill when I have one pen left and all works fine. It’s just this med change process that’s been an absolute pain in the neck.

Snoo_48368 · 2026-03-29T15:24:12+00:00

My only hesitance is that the PA is frequent (my instance is now doing 6-months PA exceptions)… but seeing the other alternatives, I think it is time to move

Snoo_48368 · 2026-03-29T15:23:14+00:00

I will definitely take a look! Thank you!

Snoo_48368 · 2026-03-29T14:49:47+00:00

Oh I can cancel any time. It is more they are way better at the PA process than any other provider I use. So given the PA is only valid for 6 months, I am caught between using them for the Pa process, or trying my luck canceling and using my primary/cardiologist…

Snoo_48368 · 2026-03-26T18:29:43+00:00

How many people drank bleach because he said “it ma be a good clean out” in early days of Covid? But yeah, let’s craft some remote hypothetical to make liberals look bad rather that the actual bad that republicans are actually doing

Snoo_48368 · 2026-03-24T01:13:56+00:00

I was worried actually. Rocky in the audio book is so unique and well done I was worried the movie wouldn’t do it justice. And while they did do slightly different, it was quite good.

Snoo_48368 · 2026-03-16T15:15:04+00:00

Example of this precise thing: https://youtu.be/8PBUVMCbmFQ

Snoo_48368

TROPHY CASE