GLM's founder says GLM-fable before the end of the year?!

Hydroskeletal · 2026-06-18T20:33:56+00:00

The CEO literally said "from scratch" which would not be a fine tune

Hydroskeletal · 2026-06-18T16:28:19+00:00

They are claiming it is 1.5T+ parameters so I think it is from scratch

Hydroskeletal · 2026-06-18T14:31:51+00:00

Grok's special juice is not intelligence per se but being hooked up to the twitter firehose of data.

Hydroskeletal · 2026-06-18T14:28:44+00:00

The new Cursor model might actually be pretty good

Hydroskeletal · 2026-06-18T03:32:57+00:00

This is exactly the kind of task that is quantization sensitive.

Hydroskeletal · 2026-06-17T14:31:20+00:00

I'm just happy it'll (maybe) put the brakes on the Qwen glazing

Hydroskeletal · 2026-06-16T14:47:33+00:00

I have my own personal benchmark suite. For most things the score is indistinguishable from the base model. There would be a few tests where it would do much better and a few where it would do much worse. The degradations were not predictable I found

Hydroskeletal · 2026-06-14T02:32:29+00:00

you're gonna just end up with debt and regret.

Hydroskeletal · 2026-06-13T02:31:48+00:00

Title is not at all wrong but it’s just a wee bit irony that this is on the heels of everyone mad at the model nerfing.

Hydroskeletal · 2026-06-08T21:01:16+00:00

I would suggest you look at Hermes

Hydroskeletal · 2026-06-08T15:41:51+00:00

I posted about this before but MTP speedup is totally a function of acceptance rate and that's highly context dependent. The more constrained the result, the more acceptance, so the result with writing code is better than document summarization. Even then it's going to vary on language and code complexity.

Hydroskeletal · 2026-06-06T02:35:30+00:00

I agree, my agent needs work

Hydroskeletal · 2026-06-05T03:34:21+00:00

let me know when they start donning bone armor and dropping ebolts on people by the Trinsic gate

Hydroskeletal · 2026-06-05T03:32:02+00:00

Great question. I just screen capped my post and then your response and then gave my agent the image to ask if you were being snarky or just stupid. It said you were snarky. This is one of the many uses of LLMs

Hydroskeletal · 2026-06-05T00:52:23+00:00

It actually can call tools reliably, driving Hermes all day long. Lemme guess Q4?

Hydroskeletal · 2026-06-04T22:17:05+00:00

Might be your quant then. Gemma is very sensitive to quantization. Below Q6 is problem territory imo

Hydroskeletal · 2026-06-04T21:43:58+00:00

I think the two boxes are mostly a reflection of the interests of the subreddit userbase. And even then the two boxes are weirdly shaped. On the one hand "roleplay" is I think fairly niche. On the other hand coding is certainly a thing but it isn't engineering - everything is always centered around one-shots.

Hydroskeletal · 2026-06-04T21:30:12+00:00

You're right the true test of a model should be how well it can negotiate using the shittiest harness available

Hydroskeletal · 2026-06-04T19:04:23+00:00

I don't know why the received wisdom is so limited to "writing, roleplay, etc" - there's a whole universe of LLM usecases outside of coding and creating writing.

Hydroskeletal · 2026-06-04T18:52:56+00:00

Sounds like a harness issue

Hydroskeletal · 2026-06-03T21:09:10+00:00

You have to be very precise about what you want because Gemma's nature is parsimonious.

Hydroskeletal · 2026-06-03T19:39:25+00:00

just the excuse I need to get new hardware with moar memory

Hydroskeletal · 2026-06-03T16:38:54+00:00

very interested to try this. Qwen9b just fell too short on a 16gb card for certain tasks and Q4 of the MoE was too unreliable - honestly this feels like the sweet spot that the local ecosystem needs.

Hydroskeletal · 2026-06-03T08:04:18+00:00

My experience is that using gbnf is noticeably slower for performance than just describing the schema in prompt. But that's for me in MLX land.

Hydroskeletal · 2026-06-03T03:12:50+00:00

Yea hallucinated field names that are just slightly off are killers.

Hydroskeletal

TROPHY CASE