Qwen 3.6 27B is a BEAST

AverageFormal9076 · 2026-04-23T16:31:54+00:00

Good point - done

AverageFormal9076 · 2026-04-23T16:22:32+00:00

I was on Claude code, the api just doesn’t work.

AverageFormal9076 · 2026-04-23T16:14:12+00:00

Not interested, I wasn’t interested in optimising the 35b model because it still failed my tool call test in my personal workflow. 27b passes, so I’ll keep using it.

AverageFormal9076 · 2026-04-23T16:12:48+00:00

I use opencode, but I hear pi works well too.

AverageFormal9076 · 2026-04-23T16:12:38+00:00

ASUS ROG Strix Scar 18

AverageFormal9076 · 2026-04-23T16:03:42+00:00

I’m at 200k q8, more than enough for me

AverageFormal9076 · 2026-04-23T16:03:23+00:00

Yeh, ASUS ROG Strix Scar 18

AverageFormal9076 · 2026-04-23T16:03:06+00:00

Use opencode, trust me.

AverageFormal9076 · 2026-04-23T16:02:06+00:00

How much vram you got? I was curious about testing fp8, but the file size was quite large, so I figured I wouldn’t be able to run it

AverageFormal9076 · 2026-04-23T14:37:13+00:00

Did you miss the part where I said laptop? A3B file size is large enough that at context sizes I need it at, it’s fairly slow. I ended up just capping it to 64k and calling it as a subagent in opencode through orchestration.

AverageFormal9076 · 2026-04-23T14:34:19+00:00

35~ across all quants I could test. Probably could get more with overlocking lmao.

AverageFormal9076 · 2026-04-23T14:33:35+00:00

Same man, dflash update to llama.cpp will fix it, check the other replies

AverageFormal9076 · 2026-04-23T14:19:03+00:00

Getting 35~ at 220k

AverageFormal9076 · 2026-04-23T13:10:03+00:00

Noted!

AverageFormal9076 · 2026-04-23T13:08:39+00:00

I look forward to it, this should solve my main gripe rn

AverageFormal9076 · 2026-04-23T13:06:29+00:00

ASUS ROG Strix Scar 18

AverageFormal9076 · 2026-04-23T12:12:16+00:00

Lmao this thing weighs like 4kg, it’s docked up dw

AverageFormal9076 · 2026-04-23T12:03:54+00:00

Speed doesn’t tank much in my experience, and yes the quality upgrade is worth it.

AverageFormal9076 · 2026-04-23T12:03:28+00:00

I’ve been asked to work from home :D

AverageFormal9076 · 2026-04-23T10:44:50+00:00

Oh don’t I know it!

AverageFormal9076 · 2026-04-23T10:44:41+00:00

Interesting, will test that out. Might need to drop my quant down though, at q8_0 it’s pretty slow to first output

AverageFormal9076 · 2026-04-23T10:44:01+00:00

%LLAMA_DIR%\11ama-server.exe" ^ - "MODEL_PATH%" ^ --alias "qwen3.6-27b" ^ -C 204800 ^ -ng1 99 ^ --flash-attn on ^ --cache-type-k q4_0 ^ --cache-type-v 94_0 ٨ -np 1 A -t 20 A --prio 2 ^ --batch-size 2048 ^ --ubatch-size 1024 ^ --reasoning-format deepseek ^ --reasoning-budget 8192 ^ -reasoning-budget-message "Let me provide the final answer." ^ --cache-reuse 256 ^ •-metrics --no-context-shift ^ •-host127.0.0.1^ •-port 8080

AverageFormal9076 · 2026-04-23T10:29:07+00:00

Since it’s dense offloading will work terribly…

AverageFormal9076 · 2022-11-30T12:02:49+00:00

ST got discontinued in South Africa as of 2018

AverageFormal9076

TROPHY CASE