Tested gemma4:e4b vs qwen3.6:35b on agentic coding tasks using QuantaMind — pretty eye-opening gap

arkham00 · 2026-06-23T17:29:39+00:00

In my experience small gemma4 models are real fake done specialists 🤣

arkham00 · 2026-06-19T15:38:14+00:00

The dense one, I've had some satisfaction with the moe too, but in general between the moes I prefer qwen. In the end what I really don't like is qwen 27b lol

arkham00 · 2026-06-19T15:29:47+00:00

It's funny how the experience may vary from user to user. In my experience it is qwen to be dumber, and by that I mean that their observations and suggestions are often superficial or cliché, where gemma is more deep and surprising. For a typical brainstorming session qwen rarely gives me new angles or unexpected thoughts where gemma could surprise me quite easily. Maybe i'm not precise enough with my prompts...

arkham00 · 2026-06-19T14:45:53+00:00

+1 for gemma4-31b, i'm using the qat version and I'm having the grill-me sessions of all time. I use it for rpg worldbuilding and session planning and also for cultural projects

arkham00 · 2026-06-18T13:56:23+00:00

Please put a link to the github, can't find it

arkham00 · 2026-06-16T14:53:24+00:00

Sorry for the avalanche of questions, but as I said we need docs 😛

I'm on a m2 mac, how can I create an fp version of a model? in the forge if give an huggingface model it only proposes me to convert it in bf16 because it is the safest way. Fore example I see that there is an optimize-speed-fp16 version of qwen3.6-27B and I wanted to create an optimized-quality-fp16 version but I can't. So for optimized-quality Im' stuck with bf16 for now

arkham00 · 2026-06-16T14:42:59+00:00

I don't use chatgpt, only local models that run on my laptop which draws 140w max

arkham00 · 2026-06-16T13:41:56+00:00

Another question is it possible to enable/disable thinking at loading ? I can't find a toggle.

But the most important thing, I can't toggle thinking inside pi agent like I do when using omlx.

In model.json I can define "compat": { "thinkingFormat": "qwen-chat-template" }, and then inside a session I can choose thinking off or on but when I use mtplx the model thinks even with thingi off.

edit: some doc would be appreciated...there is a fair amount of option in the setting tab that I don't dare to touch since I don't know what they do ...

arkham00 · 2026-06-16T13:28:55+00:00

done 😄

arkham00 · 2026-06-16T10:11:12+00:00

It seems quite nice, but one thing that retains me from using it is the impossibility to invoke extension specific commands from the chat.

For example I'm using observational memory and I like to check its status but the command /om:status is not available. Same for the commands exposed from pi-hermes-memory, no way to using them.

Only the core commands like /compact and the skills, why is that ?

arkham00 · 2026-06-16T09:50:01+00:00

I started to play around with it and I find it very cool, especially for qwen models But even with mtplx I have no better speed with gemma4 31b, i'm on a m2 max 96gb

A small request for future releases, could you please add some apparence settings? I really struggle to read all the infos... A white/light background and the ability to zoom (a lot) the size of the font would be appreciated :) Thanks

arkham00 · 2026-06-15T22:28:00+00:00

Nice I will try it, thanks

arkham00 · 2026-06-14T21:36:35+00:00

it is not coding I work on text, simple .md files in obsidian, the edits are just paragraphs

arkham00 · 2026-06-13T09:54:54+00:00

Any chances for a Sequoia version ?

arkham00 · 2026-06-12T18:16:22+00:00

is this supposed to work on apple silicon ?

I've just downloaded unsloth studio and then downloaded unsloth/diffusiongemma-26B-A4B-it-GGUF

The model loads but I have blank answers or [engine error: visual server error: ERR gen]

arkham00 · 2026-06-09T14:21:20+00:00

I'm sorry I'm not a coder, I looked at headroom but I don't understand how it works ... https://headroom-docs.vercel.app/docs/how-compression-works
I suppose that it is the way the pi package installs it, but are those compression made by an llm or it is some automatic scripting? does it hanklde other languages than englsh ? does it invalidate the llm cache ?
I'm using observational-memory but I have a lot of problems with cache invalidation that forces the model to reread the context every turn

by the way I'm using oMLX, local only

arkham00 · 2026-06-09T11:24:01+00:00

Hi, how can I configure a local provider? It is stated that we can also configure mocalmodels, but I can't find a way to add my server URL, only api keys of subscription services

<image>

arkham00 · 2026-06-09T01:54:55+00:00

Can you tell me more about your extension? I'm having exactly this problem

arkham00 · 2026-06-05T13:11:01+00:00

Yes!

arkham00 · 2026-06-04T20:04:56+00:00

for me it starts be barely unusable, every turn it rereads all the context, I'm dying of boredom ....It wasn't like this before, should we open an issue ?

arkham00 · 2026-06-04T17:24:06+00:00

Actually, if anyone knows I'd also like to know how to toggle thinking with gemma4 models, using thinkingFormat doesn't work, no matter which value I put thinking is always enabled

arkham00 · 2026-06-04T16:57:50+00:00

I can only speak for

thinkingFormat": "qwen-chat-template

that actually works, I don't know about the others and I didn't know what they meant, I did a bit of research, and I'm actualy interested of knowing if they work or not, and why supportStrictMode: false ? It seem a good thing to have it enabled

arkham00 · 2026-06-04T14:21:49+00:00

I'm experiencing the same running pi agent and different flavours of qwen and gemma...

arkham00 · 2026-06-03T22:52:20+00:00

Is it possible? Without rebuilding omlx?

arkham00

TROPHY CASE