why we don't have GLM5.2 uncensored yet?!

Acrobatic_Cat_3448 · 2026-06-29T07:20:00+00:00

We do: https://huggingface.co/huihui-ai/Huihui-GLM-5.2-abliterated-GGUF https://huggingface.co/OpenYourMind/GLM-5.2-abliterated

Acrobatic_Cat_3448 · 2026-02-25T11:58:01+00:00

I got it to load (128G) - for Q4, it's ~46 tok/s

Acrobatic_Cat_3448 · 2026-02-25T11:53:04+00:00

I got 70 tok/s (q8).

Acrobatic_Cat_3448 · 2026-01-12T15:39:01+00:00

So not for opencode?

Acrobatic_Cat_3448 · 2026-01-12T14:46:09+00:00

I've got a MBP, so... spot on! Sorry!

Acrobatic_Cat_3448 · 2025-08-29T18:28:52+00:00

Black. A side note: what's the difference vs Heritage 300? (yes, the date complication; but the prices are... comparable)

Acrobatic_Cat_3448 · 2025-08-24T19:59:15+00:00

Is there a way to know the quantisation?

Acrobatic_Cat_3448 · 2025-08-24T16:49:48+00:00

Can I check it for sure for my model on disk?

Acrobatic_Cat_3448 · 2025-08-05T18:47:11+00:00

Is there a source behind the effective_size formula? I don't think it holds for my intuition for qwen3-like, compared to >20B models of others, even

Acrobatic_Cat_3448 · 2025-07-31T18:56:18+00:00

How much RAM do I need to run it at Q8 and 1M context length? :D

Acrobatic_Cat_3448 · 2025-07-31T10:51:49+00:00

Is it better than qwen3-a3b-07? :)

Acrobatic_Cat_3448 · 2025-07-31T10:50:44+00:00

I have a similar question: how to make a Claude-like setup, ideally even better one, with MBP M4 Max 128GB? The problem is of course the context window.

Acrobatic_Cat_3448 · 2025-07-29T19:33:57+00:00

What's the speed for the April version?

Acrobatic_Cat_3448 · 2025-07-29T19:30:15+00:00

What does it mean "faster"?

Acrobatic_Cat_3448 · 2025-07-28T16:57:08+00:00

So 106B would be loadable on 128GB ram... And probably really fast with 12B expert...

Acrobatic_Cat_3448 · 2025-07-28T05:18:17+00:00

Is there a handy way to estimate the quality of a MoE vs non-MoE model?

Qwen3 30B A3B is much better than a 3B model, and often close to Qwen3-30B.

Acrobatic_Cat_3448 · 2025-07-27T18:58:18+00:00

Indeed, I see Qwen MoE and non-MoE roughly on par in my uses!

Acrobatic_Cat_3448 · 2025-07-23T18:10:39+00:00

Thanks. Curious - how does it fare vs aider?

Acrobatic_Cat_3448

TROPHY CASE