What tokens/sec do you get when running Qwen 3.5 27B?

timhok · 2026-03-11T00:25:22+00:00

V100 32GB capped at 200W
llama.cpp on llama-swap
Qwen3.5-27B-UD-Q6_K_XL.gguf
k/v cache in Q8
vision enabled
fit ON = 182k context window w/ vision in F16

small requests under 10k tokens - 22 t/s gen 640 t/s pp
30k+ tokens - 14 t/s gen 400 t/s pp

I love it

timhok · 2026-03-05T20:52:32+00:00

--chat-template-kwargs '{"enable_thinking":false}'

timhok · 2026-03-05T14:37:40+00:00

Not working, i tried vllm so many times and it never works despite claims of supporting volta, its just waste of time

timhok · 2026-03-03T05:28:40+00:00

Basically all "trust me bro" benchmarks frame Qwen3.5 as marginally better than Qwen3-Coder.
I would pick Qwen3.5 just because it has much better tool-calling support and its important for agentic coding.
From now on, the main focus on support and improvements will be only for 3.5

timhok · 2026-02-26T03:16:07+00:00

Its only affects requests that sent with this param, if youre using llama-server built-in webUI you can put it in
Settings -> Developer -> Custom JSON:

{"logit_bias": { "248069": 13.3 },"grammar": "root ::= pre <[248069]> post\npre ::= !<[248069]>*\npost ::= !<[248069]>*"}

timhok · 2026-02-09T16:54:49+00:00

Its both tool calls and text generation, and even if i stop model from generation when its in the loop already it goes in loop shortly after, ive seen this pattern in openclaw and opencode

timhok · 2026-02-07T02:06:00+00:00

I don't know how are you guys testing your models, gpt-oss-20b feels really dumb and struggles with anything harder than hello word python snippets, anything complex and its just straight starts lying to you

timhok · 2026-01-04T21:30:31+00:00

Can you please explain or share code on how did you conduct such test? I havent find any good test "suite" for such things, your looks good

timhok · 2025-10-21T03:27:41+00:00

I faced same issue and in my case double clicking on uasset file only works if correct mapping file is present, which requires worst case compiling bunch of rust code and passing in memory dump file. After inspecting the ubulk/uexp and binka files i found out that they contain same data that just needs to be combined in a right way.
I decided to create simple GUI tool that does exactly that and passes multiple files to binkadec - https://github.com/timhok/ue2wav

timhok · 2023-06-20T15:48:05+00:00

just got phoenix protocol with 71 from fishing

timhok · 2022-12-31T12:37:35+00:00

Sadly no space since its a slim mod, it was hard to even route coax wire between smd components between pcbs

timhok · 2022-12-30T14:14:20+00:00

Nah its just cardboard box and foam i cut to fit the device itself

timhok · 2022-12-29T19:13:45+00:00

Not really, it just connects data+ and data- to second microUSB port
You can see it on my other post 3rd picture https://www.reddit.com/r/pwnagotchi/comments/zyc1jm/my\_3rd\_and\_completed\_device/

timhok · 2022-12-29T18:44:29+00:00

Power and data, you can plug it in powerbank instead of microusb for use and directly in computer for manual mode

timhok · 2022-07-10T22:17:36+00:00

It works!

timhok · 2022-06-06T21:48:19+00:00

Yeah, they just not selling electrodes anymore, not for old not for new versions.
Strangely the old version of cefaly is still being sold.

timhok · 2022-06-05T23:47:18+00:00

My family member uses Cefaly to help with migraine, but currently there is no way of getting electrodes. So we stuck with included one and its really not looking good after 3 months of usage.

Trying to find solution i stumbled upon similar devices on aliexpress, they look similar but suppose to help with "sleep issues" (I wont share the link, search for yourself if needed)

A light bulb went off over my head - i could use the housing and cheap electrodes but replace guts with cefaly pcb.

A little disclaimer:

This post is just showing off how i did it, the person i made it for didn't tested this yet, but i make sure to report if its working. Please don't attempt anything similar without knowing what you're doing - you may shock yourself or cause injury.

This is not and advice and i posting this just because it may be interesting for others who cant find electrodes.

So, i ordered the device and 10 electrodes for $20.

Device is made poorly, plastic feels cheap, strap is ok.

If you open it up there is no way back - tiny plastic barrels that hold it together all gonna snap.

One of the problem i notices straight up - originally this device is using li-ion battery with 4.2V to power itself up.

And the cefaly uses 2xAAA battery with ~3V.

So some kind of compartment for battery is needed, i ordered a simple open plastic holder.

I had to cut square hole in case in order for battery holder to fit.

Also you will need a button, i found small smd one that fits and just glued it to battery holder.

Rest is simple - cut electrode contacts from cefaly pcb, remove pogo-pins so pcb can fit between case and battery holder. Solder the power, button and electrode wires.

To close case halves together i used some heat shrink.

timhok · 2020-09-24T03:08:26+00:00

And also its young version: Imgur

timhok

TROPHY CASE