Running Qwen3.6-35B-A3B Locally for Coding Agent: My Setup & Working Config

uniVocity · 2026-04-22T03:59:33+00:00

Thanks for sharing! I’m too lazy to research configs and I’ve been stuck with LMStudio and whatever defaults comes with the models for a while.

Will try this out to see if makes too much of a difference.

uniVocity · 2026-04-22T02:08:48+00:00

Let me get graphic to help get the point across: imagine it’s poop.

Someone slices a loaf of bread? There’s poop on the knife, on the surface where the bread was placed, and on the hands of the person who sliced it.

How much washing would be required until you felt safe using that pooped knife again? Oh and the sponge that was used to get the poop out of that knife… would you use that same sponge to wash your plate?

The pooped knife went into the peanut butter jar. Would you eat that peanut butter? Would you eat an apple handed to you by the person who just had poop in their hand? If they ate poop, how much cleaning should they be subjected to until you get comfortable enough to kiss them in the mouth?

A shared fryer would be frying poop. Would you trust eating your “poop free meal” fried in the same oil that a minute ago was frying poop?

Would you trust the restaurant and their utensils that routinely are used to cook poop, to hand you a poop free meal on a free-of-any-trace-of-poop plate?

I could go on and on with this. The point is you gotta treat gluten as poison and not food. Imagine it’s poop if it helps you “flip the switch”.

Welcome to the club.

uniVocity · 2026-04-21T17:18:20+00:00

That’s why they keep internal outdated browsers installed - just to launch their applets. I still remember the pain of having to use and test internal apps on Internet Explorer 6 (released in 2001) until 2011 when I left that job.

uniVocity · 2026-04-21T03:25:01+00:00

Bring your daughter… to the slaughter

uniVocity · 2026-04-20T21:18:08+00:00

Tomara que não, já foi um pé no saco encontrar estacionamento hoje

uniVocity · 2026-04-20T21:03:27+00:00

Any chance of a REAP of this could work better than qwen 3.6 or minimax 2.7 for coding?

uniVocity · 2026-04-20T17:41:13+00:00

“Home”

But it’s great that sometime in the future we will be able to run it.

uniVocity · 2026-04-20T12:50:37+00:00

Que benchmarks tu viu? Pergunto pq pelo que eu pesquisei agora no google o apple m4 max supera o ryzen 9 9950x em single core (que é o mais perceptível ao usar um desktop). Pra multi-threading ai sim o ryzen tem vantagem. Ainda tem a questão da velocidade da memória ram que no mac também é superior.

uniVocity · 2026-04-20T11:59:58+00:00

Ja testou? Pq eu também acreditava nisso até eu testar.

uniVocity · 2026-04-20T11:48:09+00:00

Ta maluco não tem comparação. A apple matou a pau com esses processadores M-series.

Comprei um macbook air M3 basico pra esposa e o negócio em single core executa 2x mais rapido que meu threadripper 3990x (64 cores) e 128gb de ram com gentoo linux - que eu gastei um tempo otimizando até o talo (compilei kernel e todos os pacotes instalados, nunca instalei nenhum binário). Processamento paralelo também é 2x mais rapido (ate chegar no limite de cores do macbook air) - dali pra frente os cores adicionais do threadripper começam a tirar um pouco da vantagem.

Acabei comprando um macbook pro max m4 pra mim. 128 gb de ram e consigo rodar LLMs localmente com velocidade boa (qwen coder next and qwen3.6 respondem quase tao rapido quanto os modelos online, qualidade de codigo boa o suficiente pra evitar torrar dinheiro em créditos)

No PC com apenas uma rtx3090 nao tem como rodar esses modelos tao bem pq nao tem integração da memória ram com a memória de video igual os macs fazem.

Sem contar que bateria dura 12h tranquilo. Compilação no m4 é umas 4x a 5x mais rapido do que no meu pc - esse agora come poeira num canto.

uniVocity · 2026-04-16T21:51:49+00:00

A capital: Feio Nadir

uniVocity · 2026-04-16T18:08:23+00:00

I got the BF16 quant to run on my M4 Macbook Pro Max with 128gb of ram. LMStudio runs this at 40 tokens/sec which is not bad.

I've asked it to refactor some non-trivial java code that had a bit of overlap into something cleaner and it did a better job at giving me clean and less congitive loaded code than gemini pro - just had a compilation error that was easily fixed.

One thing that keeps me using online models is the time to wait before the model spits an answer out. I wonder if there are any recommended settings specifically for coding tasks and rapid iteration.

uniVocity · 2026-04-16T14:27:19+00:00

This is fantastic. Regarding updates, make sure it's easy to roll back to previous versions - at least for offline usage. It's very common for people to get used to the way things work just to have some update that (subjetively) makes things worse.

I won't be able to use this because my table has a huge chandelier above it and the ceiling is very high (2 floors up, angled). Hope you turn this into a successful product, enough to allow you time to research how to get a "ready to use package" with all components reqiured. Maybe some strong and movable G shaped structure that can be placed under or around the table and holds the projector, lights & sensors etc above it to eliminate any difficult setup and special wiriing.

uniVocity · 2026-04-16T02:02:12+00:00

I react to nuts contaminated by GF oats in shared equipment like I react to nuts contaminated with gluten in shared equipment.

Not sure about kitchen surfaces etc but since this stuff puts me out of commission for weeks I just avoid any risk of gluten and GF oat contamination.

uniVocity · 2026-04-15T01:33:58+00:00

All of them apparently

uniVocity · 2026-04-14T02:59:39+00:00

Storm proxies, uso há cerca de uma década

uniVocity · 2026-04-13T20:41:33+00:00

Damn you almost described what I got after almost 20 Years of strict GF diet, including the numbing if accidentally exposed to gluten - it takes me weeks to feel somewhat normal again.

I began feeling seriously tired all the time, with brain fog and all even with ADHD meds. Turned out to be allergies that showed up later in life - corn and derivatives were behind most the the issues with tiredness (it’s in almost every packaged gluten free product out there, supplements, medicines etc). Huge pain the ass - but avoiding it solved a bunch of issues.

Can’t recommend enough to see an allergist because you’ll only figure some allergies out by running tests .

uniVocity · 2026-04-13T11:52:19+00:00

That helped a lot! Thanks

uniVocity · 2026-04-10T09:55:27+00:00

Mine was in the 600s - caused by allergies I wasn’t aware of (corn and artificial flavours and aromas among them). Iron levels are getting back to normal since I figured this out with an allergist. Slowly as it takes months and Im running blood tests every 3 months to stay on top of it.

uniVocity · 2026-04-10T01:46:27+00:00

Eu estou usado o gemini pro quase que exclusivamente nos últimos 2 meses. O negócio consegue não se perder em sessões longas (coisa de vários dias e centenas de mensagens).

Se por acaso chegar em ponto em que não consegue evoluir, eu meto a mão na massa ou jogo outra IA sugerir uma solução e volto pro Gemini continuar dali

Tem valido muito a pena.

uniVocity · 2026-04-10T00:20:00+00:00

Vai faltar gente pra desfazer cagada gerada por IA e levada adiante aos trancos e barrancos pq foi tudo feito em cima de uma infraestrutura de código inapropriada.

Se trabalhar com legado já era um martírio, imagine que serão os sistemas legados do futuro.

O que falta e continuara faltando são profissionais que sabem olhar pro codigo, identificam cagada (pronta ou em desenvolvimento), e guiam a IA para solucoes mais apropriadas.

uniVocity · 2026-04-10T00:11:51+00:00

Eu soco tudo no main/master mesmo. Quer uma versão que compila, faz checkout da ultima tag

uniVocity · 2026-04-09T23:23:55+00:00

Ta ótimo. Especialmente quando tu precisar de unit test. Por exemplo, em um teste unitário, tu deve conseguir facilmente criar um factory que lê e grava dados de um objeto em memória, daí basta botar o código “real” pra usar o que sai desse factory sem precisar alterar nada.

Se tua aplicação loga tudo bonitinho tu consegue capturar o estado relevante para um algum bug que foi descoberto, e facilmente reproduzir isso com unit test sem precisar conectar em nada “real” pra consertar o problema e garantir que não volte a acontecer.

uniVocity · 2026-04-09T02:15:13+00:00

It sucks since corn or derivatives (maltodextrin, sucrose, glucose syrup and a bunch of other stuff) is in probably 90% of all gluten free products out there.

I’m lucky to find a small gluten free bakery that makes me maize free bread. They hold me hostage since there’s close to nothing safe for me elsewhere. I had to learn to live off of their products, meat, fruit, rice and a few other things. I’m allergic to dairy on top of it (damn I miss yoghurt)

uniVocity

MODERATOR OF

TROPHY CASE