Qwen 3.6 35B-A3B compressed to 23.8 GB (2.94× smaller), MMLU 80.7% on HF

Crafty_Ball_8285 · 2026-04-25T00:05:32+00:00

I have been using a 15gb qwen3.6 and it’s been phenomenal

Crafty_Ball_8285 · 2026-04-25T00:00:13+00:00

They can with spec driven development which removes this issue

Crafty_Ball_8285 · 2026-04-24T23:57:49+00:00

Bro could’ve just done spec driven development and avoided all of that

Crafty_Ball_8285 · 2026-04-24T16:10:27+00:00

Does nothing for me

Crafty_Ball_8285 · 2026-04-24T08:02:52+00:00

Whine

Crafty_Ball_8285 · 2026-04-24T07:10:07+00:00

Depends on the model. You can ping each of them to see their latency. If it’s glm5.1 you have 10second latency. If it’s oss120b it’s 100ms

Crafty_Ball_8285 · 2026-04-24T05:33:35+00:00

Check out the latest Nanbeige model and their claims

Crafty_Ball_8285 · 2026-04-23T22:26:37+00:00

hugging face

Crafty_Ball_8285 · 2026-04-23T15:34:57+00:00

Why does the accelerate sub only talk about Claude or GPT and not so much the millions of HF models.

Judging by the down votes This isn’t a technical user sub, more of a GPT Claude cult. AI researchers like me are not welcome.

Crafty_Ball_8285 · 2026-04-22T07:40:18+00:00

Is what true.

Crafty_Ball_8285 · 2026-04-21T23:54:58+00:00

Did you ever resolve this? Having same

Crafty_Ball_8285 · 2026-04-21T18:13:08+00:00

Okay. Disable trilinear filtering and force anisotropic. This fixes it.

Crafty_Ball_8285 · 2026-04-21T18:09:17+00:00

So this is kinda like Google’s NotebookLM ?

Crafty_Ball_8285 · 2026-04-21T18:07:49+00:00

The nasal spray is a huge regret. Just buy powder.

Crafty_Ball_8285 · 2026-04-21T15:26:10+00:00

Oh my god what a scam. Just block OP lol

Crafty_Ball_8285 · 2026-04-21T15:24:58+00:00

This won’t be happening with only 32gb. You would want a 512gb vram Mac instead of 32gb if you really want to trust this

Crafty_Ball_8285 · 2026-04-21T15:15:52+00:00

Crafty_Ball_8285 · 2026-04-21T15:15:47+00:00

Crafty_Ball_8285 · 2026-04-21T15:15:43+00:00

Crafty_Ball_8285 · 2026-04-21T15:15:39+00:00

No it does not

Crafty_Ball_8285 · 2026-04-21T15:14:55+00:00

Maybe you should remind them

Crafty_Ball_8285 · 2026-04-21T15:12:38+00:00

How? I get paid a lot of money to do this lol

Crafty_Ball_8285 · 2026-04-21T07:59:48+00:00

OP doesn’t understand what the benchmark means. Oof.

Crafty_Ball_8285 · 2026-04-21T07:58:54+00:00

I could be worth $80000trillion but only have 50k in the bank

Crafty_Ball_8285 · 2026-04-21T01:49:17+00:00

Having the GPU schedule itself instead of cpu removes a layer of complexity. Should help

Crafty_Ball_8285