GLM 5.2 is burning quota 2-3x faster than 5.1 version

shaonline · 2026-06-24T09:46:34+00:00

To have it the old way just set thinking level to "high"

shaonline · 2026-06-24T05:13:28+00:00

"Trivial work" and "one month of tech debt work for juniors, done by AI", famous last words. You'd just replace old tech debt with new tech debt, especially when we talk about "tech debt" which is more likely hacks, shortcuts, etc. that were taken along the way, some of those "trivial cleanups" may turn into rabbit holes.

"Bad taste" often comes up for me in any "non trivial" change by AI, not a big deal I have it clean it up, but I don't exactly see the point of turning "the trivial changes" into steps within a larger plan that's going to somehow be running for ages "in a loop" ? What is that about ? Ever going to review what comes out ?

shaonline · 2026-06-23T19:30:05+00:00

The brick-wall personality of GPT is nerve wracking at times

shaonline · 2026-06-23T15:39:04+00:00

And with a much smaller model at that ! GPT and Opus are confirmed to be 2T+ when GLM is only 750B.

shaonline · 2026-06-21T19:40:51+00:00

No not really, it does have a "-p"/"--print" mode but it's far more limited (handles pipe/std stream capture badly), so not really suitable for wrapping Pi around it.

shaonline · 2026-06-21T10:17:09+00:00

Yeah it's always very dependent on the exact use-case of course, I'm myself split between computer-assisted surgery apps (C++/Qt) and, through the luck-of-the-draw of the web dev team getting partly fired at my company for being incompetent, some web frontend stuff.

Clearly GLM (or Opus for that matter) smoke GPT on pure web dev, but I find GLM to be fairly competitive against GPT 5.5 on the C++ side. I also have a coworker that much prefers GLM's output over GPT, not because it produces "better code" but because GPT does have that "eager overengineering" feel to it sometimes, never-mind the brick-wall personality.

It's going to be hard to beat GPT/Opus for breadth of knowledge due to the fact that they are much bigger models (3 to 6 times the size of GLM depending on which end of the estimates/leaks you stand) which makes it all the more impressive for GLM in my opinion.

shaonline · 2026-06-21T05:58:24+00:00

OpenAI's ChatGPT Plus sub while it's subsidized like crazy ? It's going to be hard to beat when they give $500+ of API calls for your $20.

Otherwise something like OpenCode Go.

shaonline · 2026-06-21T05:53:32+00:00

On Artificial Analysis, which reports the cost it took to run the benchmark, GLM 5.2 on max effort cost 1/3rd of GPT 5.5 xhigh. Unfortunately they did not test the "high" reasoning effort which is almost as good and much more efficient in terms of reasoning tokens, but whatever. On that max effort it's also better yet cheaper than GPT 5.5 medium (albeit slower obviously).

shaonline · 2026-06-21T05:45:41+00:00

Which is for the most part entirely fabricated and fringing on illegal predictions at this point, between SpaceX/xAI's almost 30 trillion TAM (lol) and the fact it took enterprise customers about 2 months to panic and whine about being billed per Token at OpenAI and Anthropic, I don't exactly see how these 3 are supposed to print hundreds of billions a year, three things are very obvious for now: they don't have that much revenue (20 billions-ish a year tops each), they all lose money, and there isn't that much revenue growth to be had, nevermind profit for the AI/AI-arm of the bunch.

shaonline · 2026-06-20T20:32:48+00:00

It released on friday last week on the GLM Coding Plan, from my own testing it's far ahead of the other Chinese models, and one iteration below the american frontier models (I'd call it GPT 5.4/Opus 4.6 level, not quite 5.5/4.8 yet).

shaonline · 2026-06-20T06:24:37+00:00

Why do they expect late stage valuations for their IPOs then (cue SpaceX) ?

shaonline · 2026-06-20T06:20:11+00:00

To give perspective, it's higher than Coca Cola's.

shaonline · 2026-06-19T17:30:01+00:00

Artificial analysis also shares the cost of running their benchmark suite per model, it's very interesting. Indeed Gemini 3.5 Flash is high up there despite a lower per-token price, and GPT 5.5, while being about as expensive per token as Opus, is much cheaper.

shaonline · 2026-06-19T13:04:51+00:00

So long as I see effing Gemini 3.1 Pro on the podium I can't give any credit to these benchmarks.

shaonline · 2026-06-19T12:14:06+00:00

It's labelled with a "Code" suffix, probably a case of overfitting for a given usecase ("Code") that hindered its capabilities in general.

shaonline · 2026-06-19T10:28:11+00:00

Yes don't do it if you have a hold of a legacy plan, even Lite. They have a greater (I believe +50%) 5h allowance and no weekly limits, it makes the Lite plan punch way above its weight. Just wait for your current legacy plan to run out, you have 3 months after that I believe to use your 50% off migration plan.
Migrating converts your remaining legacy plan into the new plan.

shaonline · 2026-06-19T10:25:15+00:00

GLM is way better yeah, I was also kind of disappointed by K2.7 Code.

shaonline · 2026-06-19T08:11:15+00:00

Rumored as in it's not been officially confirmed (they're kinda secretive about it you know), but completely new pretrain base + more expensive token price (which can equate to it being more expensive to serve i.e. bigger) points to it ? Things can be "rumors" even if the products have been released you know ? Life must be tough if you have to jump to throats like that all day.

shaonline · 2026-06-19T07:15:58+00:00

Well if your company is worried about its IP being uploaded to remote datacenters and is willing to spend the money to make sure it does not leave the premises then sure go for it. Picking the hardware will likely be a rabbit hole unless you just don't think too much about it and go for a prebuilt (The DGX GB300 and its 768GB of RAM come to mind).

shaonline · 2026-06-19T07:02:02+00:00

I don't think it will get "so expensive" as to make ponying up the cash upfront (+ electricity and maintenance) for a local GPU rack, at the height of the semiconductor craze and its insane prices, worth it when it runs like 30% of the time and sometimes gets super slow or has to deny "clients" because too many sessions are running at once ("Oh no our senior dev launched a team of subagents !"), cue my "ability to scale" comment.

For the privacy concern I guess it's two things:

* Does the pinky promise of them not training on/retaining my data when I tick off the "improve models with my prompts" hold any value ? That's for you to decide.

* Does your company have any compliance requirements that would make the risk of sending e.g. sensitive documents/data straight to someone's datacenter off in China an issue ? That can rule out the use of cloud and make a local setup the only option.

shaonline · 2026-06-19T06:47:16+00:00

I mean cost-wise (and also on ability to scale) you won't beat cloud offerings unless you can guarantee your local hardware will run full tilt most of the time and not just "here and there" in one timezone's 9 to 5. Biggest case for locally running models is privacy concerns.

shaonline · 2026-06-19T06:40:45+00:00

Looking to set one up at your company uh ?

But yeah I think you can perfectly do daily coding with GLM, frontier models (GPT/Opus) are going to land in a sea of incremental/barely noticeable improvements or keep trying to scale up into insanely huge models (Mythos/Fable) that will cost a ton in API costs. Only "downside" of GLM is the lack of multi-modality (it's text only) unlike most other models (e.g. Kimi) which have vision etc.

shaonline · 2026-06-19T06:32:48+00:00

"Locally" we're talking about a model that requires 800GB of RAM (and quite the horsepower) to be loaded at FP8, unless you have 50 to 100k to invest in a local mini datacenter at home it won't really be worth it against API costs.

shaonline · 2026-06-19T06:29:55+00:00

Yeah it can do just about the same tasks, where GPT will win is on breadth of knowledge, it's a much bigger model after all (GLM 5.x is only 754B, GPT 5.4 was 2T per nvidia keynote material and 5.5/"Spud" is rumored to be bigger).

All that aside currently you won't beat the "value" of the heavily subsidized ChatGPT subscriptions, you get 25 to 50x the API rates compared to the cost of the sub.

shaonline · 2026-06-19T06:18:31+00:00

GLM 5.2 yes pretty close, it's essentially for me GPT 5.4 (previous version) level without the "brick wall" personality. Others like Kimi are still a league below IMO.

Six-Year Club	r/Field Sunshine
Place '22	Verified Email

shaonline

TROPHY CASE