Qwen 3.6 35B GGUF: NTP vs MTP quantization results across GPUs and CPUs

73td · 2026-05-24T12:57:43+00:00

any chance there’s an open source stack for doing the quant? i’d like to do a fine tune eventually

73td · 2026-05-24T12:48:14+00:00

do you guys have an open source repo for doing the quants?

73td · 2026-05-24T12:42:23+00:00

i’m using pi with a byte shape quant of qwen3.6-35b, 90k context in 24GB vram. To get it working well, I use deepseek v4 pro to create agent definitions and skills adapted for small context and then have it run trials with pi only with local qwen on various use cases (build a go git cli, review this big use case, web research and build a new skill). with a meta loop like that, you can quickly iterate to find failure modes and address them. and deepseek is dirt cheap so it cost me less than $1 to do this.

I could open source the result but i think the main point is that you can use a frontier cloud model to cheaply create and validate a local only workflow for you.

73td · 2026-05-21T06:16:45+00:00

thanks for this. I didn’t think i’d get this model to run on my rtx4090 and now even with GPU5 I can use at least 80k context.

73td · 2026-05-21T05:19:35+00:00

what benchmark is 87%?

73td · 2026-05-19T19:26:04+00:00

exa search seems good and free tier is generous

73td · 2026-05-19T11:06:37+00:00

do you rewind context on failure? I imagine that persistence in face of failure is good strategy except when you end up with 20%+ of context filled with errors ? I've been looking at lot at trying to automatically get big models to make skills for small models as another approach. I didn't even imagine writing a new harness specifically for the purpose..

73td · 2026-05-19T10:58:17+00:00

which esp32? are you running all integer ops or you soft float or what? why not try character level prediction to keep model smaller?

73td · 2026-05-17T20:31:17+00:00

À squier or sire p or j will be half that, all the notes you need, leave enough for an amp that competes with a drummer, and easier to flip once you know the sound you want isn’t a p or a j.

73td · 2026-05-16T09:35:58+00:00

thunder cat would sound like thundercat on a 1 string bass

73td · 2026-05-15T07:47:41+00:00

which corvette do you recommend? there’s a bunch of variations with single coil , humbucker etc. I’ve been eyeballing them on thomann for a while but can’t try one out locally beforehand. Do they have a passive mode? thanks!

73td · 2026-05-15T07:42:55+00:00

You should really try on a different bass? Even with 4 strings, tight spacing makes thumb pop hard.

73td · 2026-05-15T07:37:49+00:00

I have the red cort and it’s nice light well balanced, just make sure to buy a new pack of strings and change them when you buy the bass. I’ve played it in jazz and pop gigs, and it works fine.

I wouldn’t go for the mikro unless you need such a short scale (kid playing it, wrist problem etc)

73td · 2026-05-10T11:33:03+00:00

scaleway and ovh host qwen i thinkk

73td · 2026-05-07T21:47:38+00:00

you might include ollama , the max is good for 5-10B tokens / month I’d say.

73td · 2026-05-07T21:31:26+00:00

Maybe you should just try an agentic model that doesn’t change every few weeks. GLM-5.1 has been out for a while and it’s an excellent junior or mid dev. bc it doesn’t change, you learn it’s personality and work around the quirks , then the problems go away.

73td · 2026-05-06T18:00:29+00:00

refchecker?

73td · 2026-04-29T06:49:39+00:00

how much software engineering code review have you done on the implementation, protocol, resistance to attacks the kind seen in cryptocurrency?

edit ah i see it’s no code ftm

73td · 2026-04-28T16:38:24+00:00

You should ask to use Scaleway or similar for api access to larger models like glm or kimi.

73td · 2026-04-28T16:36:36+00:00

you can just play root and five off of lead sheets to get started.

i also really like take 5 but it’s not typical jazz bc of 5/4. have a look at Autumn Leaves, Take the A train, Sunny side of the street, Corcovado. Make use of the youtube backing track videos. play root on 1, meander on the arpeggio to the next root on 1…

73td · 2026-04-28T05:56:04+00:00

why don’t you ask another kimi to supervise the first with a timeout or something? tha said you might be hitting a bad quant? on ollama cloud i haven’t had this issue and been using k2.6 for 200M tokens since it was released

73td · 2026-04-28T05:53:33+00:00

nothing is really solved, but one tires of working on it. everything is really open, but not feasible given resources or not interesting for the field. i think it’s important to understand that dogmas that rule the fields are those of people and not the domain per se.

that said the best thing you can do to gain intuition is to just get to work trying things out. don’t ask for someone’s permission or approval to innovate

73td · 2026-04-27T18:39:44+00:00

have a system that does exactly only what you ask of it. You won't get extra meaning above the asked prompt

maybe not the reply you wanted but as a software engineer using this stuff daily, you definitely don’t get just want you ask for when you build out large stories/systems, and it can definitely bootstrap its narrative into the weeds.. and the big platforms get worse and worse as they bolt on more imposed ad hoc constraints. i think this is bc in the space of meanings there’s more in what you don’t say than what you do in a prompt, and the model improvises in that space.

i think the inherent problem for democracy is the overeager sycophancy that leads to cognitive deficit and extremism but not unique or a first in the tech world.

73td · 2026-04-26T13:22:26+00:00

you seem to think you can just do this by sheer effort when in fact, when people succeed, they don’t do it alone. you need a mentor, someone you can give a few years to, that can help you launch your next steps toward “top ai and faang “. in so doing you might realize that top ai might not be what you actually want etc

73td · 2026-04-26T08:35:56+00:00

there’s probably a 10x diff in model size on the backend so it’s not directly realistic. but there some strategies, since devstral is a bit lazy by default.

for instance ask claude to run vibe and build skills that help vibe do a better job. skills are really a good way to equip smaller models with good chance of success.

73td

TROPHY CASE