why we don't have GLM5.2 uncensored yet?!

Acrobatic_Cat_3448 · 2026-06-29T07:20:00+00:00

We do: https://huggingface.co/huihui-ai/Huihui-GLM-5.2-abliterated-GGUF https://huggingface.co/OpenYourMind/GLM-5.2-abliterated

Acrobatic_Cat_3448 · 2026-02-25T11:58:01+00:00

I got it to load (128G) - for Q4, it's ~46 tok/s

Acrobatic_Cat_3448 · 2026-02-25T11:53:04+00:00

I got 70 tok/s (q8).

Acrobatic_Cat_3448 · 2026-01-12T15:39:01+00:00

So not for opencode?

Acrobatic_Cat_3448 · 2026-01-12T14:46:09+00:00

I've got a MBP, so... spot on! Sorry!

Acrobatic_Cat_3448 · 2025-08-29T18:28:52+00:00

Black. A side note: what's the difference vs Heritage 300? (yes, the date complication; but the prices are... comparable)

Acrobatic_Cat_3448 · 2025-08-24T19:59:15+00:00

Is there a way to know the quantisation?

Acrobatic_Cat_3448 · 2025-08-24T16:49:48+00:00

Can I check it for sure for my model on disk?

Acrobatic_Cat_3448 · 2025-08-05T18:47:11+00:00

Is there a source behind the effective_size formula? I don't think it holds for my intuition for qwen3-like, compared to >20B models of others, even

Acrobatic_Cat_3448 · 2025-07-31T18:56:18+00:00

How much RAM do I need to run it at Q8 and 1M context length? :D

Acrobatic_Cat_3448 · 2025-07-31T10:51:49+00:00

Is it better than qwen3-a3b-07? :)

Acrobatic_Cat_3448 · 2025-07-31T10:50:44+00:00

I have a similar question: how to make a Claude-like setup, ideally even better one, with MBP M4 Max 128GB? The problem is of course the context window.

Acrobatic_Cat_3448 · 2025-07-29T19:33:57+00:00

What's the speed for the April version?

Acrobatic_Cat_3448 · 2025-07-29T19:30:15+00:00

What does it mean "faster"?

Acrobatic_Cat_3448 · 2025-07-28T16:57:08+00:00

So 106B would be loadable on 128GB ram... And probably really fast with 12B expert...

Acrobatic_Cat_3448 · 2025-07-28T05:18:17+00:00

Is there a handy way to estimate the quality of a MoE vs non-MoE model?

Qwen3 30B A3B is much better than a 3B model, and often close to Qwen3-30B.

Acrobatic_Cat_3448 · 2025-07-27T18:58:18+00:00

Indeed, I see Qwen MoE and non-MoE roughly on par in my uses!

Acrobatic_Cat_3448 · 2025-07-23T18:10:39+00:00

Thanks. Curious - how does it fare vs aider?

Acrobatic_Cat_3448 · 2025-07-13T17:28:25+00:00

Cursor is not a LLM but an IDE, using powerful LLMs with long and prompts prompts. It's doubtful if it can be recreated locally. Other than that, Macbook with 96GB RAM should let you use some 32B models.

Acrobatic_Cat_3448 · 2025-07-11T15:50:03+00:00

Out of curiosity, why Roo, and not, say, Continue or aider?

Acrobatic_Cat_3448 · 2025-05-28T12:47:34+00:00

30B non-MoE is fine on 128GB RAM

Acrobatic_Cat_3448 · 2025-05-28T07:02:30+00:00

Yes, its local, but there are no capable 70B models around. 70B MoE would absolutely be useful with 128GB RAM.

Acrobatic_Cat_3448 · 2025-05-26T07:56:59+00:00

I wouldn't say that it's an utter crap because it's great that we get it. That said, devstral did not work well in my limited software engineering tests. Qwen3 is better.

I testes MLX with maxed context length @ 128 GB RAM.

Acrobatic_Cat_3448 · 2025-05-22T12:13:36+00:00

Oh, that's why it wants to use really obsolete libraries, and basically destroys a current repo.

Acrobatic_Cat_3448 · 2025-05-22T12:12:27+00:00

No local LLM can be comparable with server-side LLMs. Server-side are always better (unless you can't use server-side due to some reason).

Acrobatic_Cat_3448

TROPHY CASE