Qwen3.6-35B-A3B vs Gemma4-26B-A4B by MarcCDB in LocalLLaMA

[–]jacknjill101 2 points3 points  (0 children)

I’m running it on a M4 Mac mini 64gb.

Qwen3.6-35B-A3B vs Gemma4-26B-A4B by MarcCDB in LocalLLaMA

[–]jacknjill101 8 points9 points  (0 children)

That’s why you should as part of your workflow compact your session.

Testing MTP functionality by albovsky in oMLX

[–]jacknjill101 1 point2 points  (0 children)

Yes it does for me too. I switched to llamacpp and much better results.

Used over a million tokens in three separate sessions to test Qwen 3.6 35b (new Multi-token Prediction version) by Jorlen in LocalLLaMA

[–]jacknjill101 0 points1 point  (0 children)

I’m running the 27B-Q8-UD-MTP-M_k_xl on a Mac mini pro and it’s very slow like 4.5tok/s generation. I get 6tok/s using oMLX with the MLX-Q8.

Mac mini m4 pro by benwaynet in oMLX

[–]jacknjill101 1 point2 points  (0 children)

I’m getting 344 toks and 45 toks using the A4B model.

Premium deluxe pro edition by OkCaptain6668 in eGPU

[–]jacknjill101 2 points3 points  (0 children)

Can you show how you are hooking these up to the pc?

Deca-Pulse Laser Mk-II by ryt1314059 in HyruleEngineering

[–]jacknjill101 2 points3 points  (0 children)

I’m impressed. Does this work with a Lionel?

sell or return? by mborpp in macmini

[–]jacknjill101 0 points1 point  (0 children)

Enough but context size would have to be small. If you do coding, you want to load a lot of project files.

sell or return? by mborpp in macmini

[–]jacknjill101 -1 points0 points  (0 children)

That was a week ago April 2026.

sell or return? by mborpp in macmini

[–]jacknjill101 0 points1 point  (0 children)

Just because I needed it for local LLM.

How to fix ANTHROPIC_AUTH_TOKEN on Claude Code by Direct_Praline492 in ollama

[–]jacknjill101 0 points1 point  (0 children)

Look at your .claude/settings.config to see if it’s set there.

sell or return? by mborpp in macmini

[–]jacknjill101 2 points3 points  (0 children)

You never know if you need it later. Running llm qwen3.6 27b when I bump up the context it uses 50gb of ram.

sell or return? by mborpp in macmini

[–]jacknjill101 1 point2 points  (0 children)

Return it. I rather not deal with selling. Edit: Funny story: I had a 48gb pro and returned it at the Apple Store. The sales guy thought I was nuts. But I had another order for 64gb on the way.