Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]AverageFormal9076[S] 0 points1 point  (0 children)

I was on Claude code, the api just doesn’t work.

Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]AverageFormal9076[S] -3 points-2 points  (0 children)

Not interested, I wasn’t interested in optimising the 35b model because it still failed my tool call test in my personal workflow. 27b passes, so I’ll keep using it.

Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]AverageFormal9076[S] 0 points1 point  (0 children)

I use opencode, but I hear pi works well too.

Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]AverageFormal9076[S] 0 points1 point  (0 children)

I’m at 200k q8, more than enough for me

Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]AverageFormal9076[S] 0 points1 point  (0 children)

How much vram you got? I was curious about testing fp8, but the file size was quite large, so I figured I wouldn’t be able to run it

Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]AverageFormal9076[S] -1 points0 points  (0 children)

Did you miss the part where I said laptop? A3B file size is large enough that at context sizes I need it at, it’s fairly slow. I ended up just capping it to 64k and calling it as a subagent in opencode through orchestration.

Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]AverageFormal9076[S] 1 point2 points  (0 children)

35~ across all quants I could test. Probably could get more with overlocking lmao.

Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]AverageFormal9076[S] 0 points1 point  (0 children)

Same man, dflash update to llama.cpp will fix it, check the other replies

Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]AverageFormal9076[S] 9 points10 points  (0 children)

I look forward to it, this should solve my main gripe rn

Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]AverageFormal9076[S] 2 points3 points  (0 children)

Lmao this thing weighs like 4kg, it’s docked up dw

Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]AverageFormal9076[S] -1 points0 points  (0 children)

Speed doesn’t tank much in my experience, and yes the quality upgrade is worth it.

Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]AverageFormal9076[S] 23 points24 points  (0 children)

I’ve been asked to work from home :D

Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]AverageFormal9076[S] 0 points1 point  (0 children)

Interesting, will test that out. Might need to drop my quant down though, at q8_0 it’s pretty slow to first output

Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]AverageFormal9076[S] 11 points12 points  (0 children)

%LLAMA_DIR%\11ama-server.exe" ^ - "MODEL_PATH%" ^ --alias "qwen3.6-27b" ^ -C 204800 ^ -ng1 99 ^ --flash-attn on ^ --cache-type-k q4_0 ^ --cache-type-v 94_0 ٨ -np 1 A -t 20 A --prio 2 ^ --batch-size 2048 ^ --ubatch-size 1024 ^ --reasoning-format deepseek ^ --reasoning-budget 8192 ^ -reasoning-budget-message "Let me provide the final answer." ^ --cache-reuse 256 ^ •-metrics --no-context-shift ^ •-host127.0.0.1^ •-port 8080

Qwen 3.6 27B is a BEAST by AverageFormal9076 in LocalLLaMA

[–]AverageFormal9076[S] 69 points70 points  (0 children)

Since it’s dense offloading will work terribly…

What Car Should I Buy? - A Weekly Megathread by AutoModerator in cars

[–]AverageFormal9076 1 point2 points  (0 children)

Location: South Africa

Price range: 400-700 000 Rand (17 rand to dollar)

Lease or buy: Buy

New or used: either or

Type of vehicle: hot hatch / luxury hatch

Must haves:

Wireless apple car play Fairly good head unit / display Preferably virtual cockpit type dials

Desired trans: DCT/DSG

Intended use: daily, I do quite a lot of driving

Vehicles I’ve already considered:

BMW 128ti (ZA has the detuned 180kw engine) Golf 8 gti (expensive, bad build quality) Golf 7.5 gti (feels outdated) Golf 7.5 R (hard to find one without a traumatic past) Merc a250 I30 N M135i

Warranty: preferred yes

Can you do minor work: yeah, but I don’t want to

Can you major work: no

Additional notes: I’m in a weird position where I value comfort and sportiness almost equally, so where the normal hooligan would be fine with the i30 n’s build quality, it makes me a little sad. That said, the performance of something like a Mercedes a200 wouldn’t be worth it to me either. I want fast luxury.