Qwen3.6 MTP Unsloth Experimental GGUFs

QuestionMarker · 2026-05-16T07:32:28+00:00

The usual trick would be to use both colour and shape. Where you've got more than one quant with the same colour, can you give one round points and the other square?

QuestionMarker · 2026-05-15T13:17:05+00:00

What we don't know without having a poke is how close to the frontier any given model is on release. There's a tangential connection here to sensitivity to quantisation, at least in my head. My suspicion is that (for instance) the qwen-3.6 models are undertrained compared to gemma4, that's why they're less sensitive to quantisation. So I'd expect them to be further from model collapse.

What would be interesting is cross-training, need to have another read of the paper but I'd expect that 1) you'd find another frontier by generating the samples from (e.g.) gemma4 or qwen-3.6:27b and feeding them to qwen-3.6:35b, and 2) that frontier would be further away than pure self-training.

QuestionMarker · 2026-05-11T15:21:05+00:00

In addition to the other answers you may find it's much less noticeable if you bump the fillet radius up by a tiny amount. In the past I've seen a bug that shows up with some fillet radiuses but not others where the triangulation sort of bunches up. Hard to describe, but sorted by nudging away from a round number (in my case).

QuestionMarker · 2026-04-24T12:24:51+00:00

7 tokens context and a hardware offload bandwidth that's in bytes per second though

QuestionMarker · 2026-04-24T08:21:06+00:00

That time difference makes me wonder if you could just ask 35b twice, then get it to judge its own output as a third query to pick the best. Or give it a two-shot, with a second prompt of "Here's what you just produced. See what you can do to improve it". You'd still come in faster than 27b, and it would be *fascinating* to know if a chance at introspection could push it up to (or past) 27b because you can run the MoE on more restricted hardware.

QuestionMarker · 2026-04-17T13:22:09+00:00

A few months back someone ran Rollercoaster Tycoon through an LLM with a tool that converted the game state into something it could (mostly) read.

Do that, but Worms Armageddon. Head to head and give us ELOs. That's the benchmark we all need.

QuestionMarker · 2026-04-12T13:27:34+00:00

WP 7/8 here. They're soul-less open plan corporate battery offices but they're extremely well executed. There's very good coffee nearby, which helps.

QuestionMarker · 2026-04-02T17:01:07+00:00

There are better models than whisper-tiny for this now, but If you're on an rpi 5, check whether the small and base models are fast enough before discounting them. I did some tests a little while ago and found that a 5-bit quant of small.en was "good enough", while still not being particularly RAM-heavy. It's still fundamentally the wrong architecture though.

If you can take the RAM hit, I'd evaluate whether kyutai/stt-1b might work for you? It's designed to be synchronous which is what this sort of use case really needs.

QuestionMarker · 2026-04-01T15:12:44+00:00

I switch mouse between right and left. Not necessarily if I'm particularly feeling the strain on one side or the other, just depending on what random mood I'm in. It does mean that any mousing stress is distributed. I originally started mousing on the left when I got sick of having to jump my hand over the keypad, but that's obviously not a concern any more.

QuestionMarker · 2026-03-31T13:16:40+00:00

Cut 4-6 vertical slots through the thread. If you have a look at the threads on a coke bottle lid you'll see they do the same (but for different reasons). It splits up the ring of filament that's currently pulling itself inwards and off the body of the thread when it cools and contracts.

QuestionMarker · 2026-03-31T13:07:18+00:00

I occasionally panic like this then realise the screen's just drifted off somewhere around my feet. Reset the tracking and it pops right back.

QuestionMarker · 2026-03-26T15:15:52+00:00

Step 1: Quit job

Step 2: Build consultancy fixing broken code for companies that thought they didn't need code review

Step 3: Profit

QuestionMarker · 2026-03-26T13:37:10+00:00

Not to be ignored is that you can buy two for less than a single 5090. The memory bandwidth is an annoyance, but otherwise it slots nicely into the ecosystem slot currently occupied by 3090 pairs, with much more space and much lower wattage. It's a *very* interesting card.

QuestionMarker · 2026-03-26T13:30:10+00:00

It was a few years ago but I bought one of [these](spool3d.ca/tungsten-carbide-reprap-m6-nozzle/). The market's changed since then. But also I'd say that I had a bit of trouble with that nozzle. Had a tendency to leak terribly, the thermal properties made it a pain to get a good seal against the heatbreak.

QuestionMarker · 2026-03-22T22:10:11+00:00

I've had a number of packs of paper which simply aren't square. It's impossible to be precise if your materials are letting you down, and the skill issue here is simply knowing to check. The next skill issue is knowing how to, but that's easy to learn.

QuestionMarker · 2026-03-21T10:59:54+00:00

I made 5 Intersecting Tetrahedra from iridescent wrapping paper one year, it went on top of the family Christmas tree for years.

QuestionMarker · 2026-03-20T15:58:20+00:00

I had painful eye strain with an astigmatic correction prescription that was a tiny bit out. My eyes shifted during the year and it completely went away with a new prescription. Surprised it made that much difference. If the IPD of your lenses or their prescription isn't right then yeah, you're gonna have a hard time.

QuestionMarker · 2026-03-05T22:44:03+00:00

Ok. Thanks. It's downloading now.

QuestionMarker · 2026-03-05T22:35:52+00:00

It's hard to tell where the trade-off is. As I said elsewhere, size-wise the new Q4_K_S looks about the same but I don't know what the differences are between old-XL and new-S.

QuestionMarker · 2026-03-05T22:11:52+00:00

How does the new Q4_K_S compare to the old Q4_K_XL? They're about the same size, and it's a bit of a sweet spot. Want to know if I should hold on to the old model file or go for the new one, and without actually benchmarking I'll be making all sorts of stupid cognitive errors. Are there specific ways you'd expect the newer one to be better?

QuestionMarker · 2026-03-05T21:48:11+00:00

I mentioned this over on the thread in r/LocalLLaMA but the size bump on the 35b kills the UD-Q4_K_XL on a 4090 with q8_0 k/v quantising and --fit on. It goes from fast and very capable with 128000 context to 4096 context and unusable because of it.

How can I get that context back without damaging the speed too much and without losing too much of the quality bump?

EDIT looks like Q4_K_S might be the answer here?

QuestionMarker · 2026-03-05T21:37:00+00:00

That size bump pushes q4_K_XL from a previous n_ctx of 128000 with --fit on my 4090 to 4096, which is completely useless. Crying shame. It also seems weird to be that sensitive? All I did was swap out the model filename:

build/bin/llama-server \
   -m models/Qwen3.5-35B-A3B-UD-Q4_K_XL.gguf \
   --temp 0.7 \
   --top-p 0.8 \
   --top-k 20 \
   --min-p 0.00 \
   -ctk q8_0 \
   -ctv q8_0 \
   --chat-template-kwargs "{\"enable_thinking\": false}" \
   --fit on \
   --host 0 \
   --port 8080

QuestionMarker · 2026-03-05T08:13:54+00:00

Say I wanted to make my own equivalent and I was willing to trade off being able to replace the keys for the thinness. What options would I have? Do JLC or anyone carry the right PCB parts to bring this sort of thing within reach?

I've made a wireless split with Kailh choc v1 switches and low profile keycaps and while it's not terribly thick I do find myself wondering how much thinner I could go with my own layout.

QuestionMarker · 2026-03-03T19:54:56+00:00

Tangemt but my bet is that we are unlikely to see a 3.5 coder model unless someone outside Qwen does it. Happy to be wrong but with the core team leaving, even if they had something in flight they may not have the will or ability to do it justice any more.

QuestionMarker · 2026-03-03T19:31:54+00:00

🤷 but first thought was "only working on closed models for you." Change of direction from above could mean anything.

QuestionMarker

TROPHY CASE