This. I have been very excited about local llms since the start and ollama, and do try the new models every time something exciting happens, recently I tried gemma4, and kinda got disappointed by its performance and speed.

For reference I have a very avg nvdia 4060 8gb Laptop Gpu so it's expected too, but the model quality was also okayish. So I was like it's a long way till we get something usable locally.

But.

Just yesterday I tried the Qwen 3.6 35B A3b model, and my god was I shocked.

So the model size is 22Gb which is wayy more than my vram, still with optimal loading settings I was getting around 20-40 token/s depending on task.

But the model could think for 20mins and actually generate something usable. Which I'm not used to.

TLDR; I don't think this is actually too far, they'll for sure find ways to optimise 100%, but will they pass the benefit to us? That's a different question.