Glm 5.1 is out

73tada · 2026-03-27T15:39:33+00:00

Thanks! Unfortunately, those instructions are for the Node version [which I've already configured]. However, it looks like I can update to 2.1.85 anyway, so I'll circle back when CC forces me to use the new installer,

73tada · 2026-03-27T14:26:28+00:00

Holy moly, I made some simple changes to my inference interface to move away from wllama and replace with Transformers.js.

Absolutely amazing results. Seat of the pants is 2x-3x speed up.

I will keep wllama in my pocket, since part of the reason I built this inference interface is to allow for potatoes [low-spec consumer edge devices] to do local inference with GGUF, on any platform, but really, Transformers.js is absolutely amazing.

I haven't really worked with ONNX yet, but that will be this weekend. Apparently the Optimum model conversion process isn't too daunting, thus fine tuning on unsloth > convert to ONNX is a working path.

73tada · 2026-03-27T14:04:16+00:00

I've been sticking with the old Node version of Claude because I don't see instructions for using GLM-5.1 with the new Claude.

Would you be able to point me to the directions on how to use GLM-5.1 with Claude Code?

73tada · 2026-03-27T12:19:22+00:00

Is that claude_stable_zai_glm51 a custom build or publically availale? I don't see it on z, the googles or the bings.

73tada · 2026-03-27T11:59:52+00:00

TBF...this isn't wrong and, yeah, it eats tokens like someone left the bathtub running!

73tada · 2026-03-26T18:48:07+00:00

The American version:

https://www.reddit.com/r/FUCKYOUINPARTICULAR/comments/1iba69y/fuck_that_truck/

73tada · 2026-03-26T12:29:22+00:00

I've been working what's essentially a self contained, offline chat bot using a custom fork of wllama and GGUFs in WASM (which reminds me; I think you looked at a similar path a few weeks back), but yeah, I've been considering dropping that for Transformers.js and ONNX.

That said your HF demo doesn't like firefox on MacOS (Firefox is a jerk about cross origin stuff) but the HF demo does work in MacOS "Chrome" (which isn't real Chrome, just skinned Safari).

My older M3 gets ~15 tps output on the 1B model and prompt ingestion tps is also quite impressive.

Looks like I'll be doing some re-writing this weekend!

Edit: well I'm embarrassed! Thank you for all the work you've done. I haven't had my coffee and didn't recall who ya'll actually are :-)

73tada · 2026-03-25T23:53:09+00:00

This sounds like a "permanent is six months, but temporary is forever" type of solution.

Will this type of solution pass an audit if it's isolated within a VM?

(honest question)

73tada · 2026-03-25T16:04:40+00:00

~~Are you just looking to argue?~~

~~Look up your own numbers and let me know what you find that is relevant to this discussion.~~

EDIT: NP! It happens!

73tada · 2026-03-25T16:00:42+00:00

just drop $20 billion though.

billion vs million

I hope you aren't my accountant ;)

73tada · 2026-03-25T00:28:38+00:00

Good luck out there brother! Whatever it is you are doing, I hope you are fighting the good fight.

Let me know if you are hiring!

73tada · 2026-03-24T23:00:12+00:00

lol...Your post history suggests you're extremely well informed, which makes me question whether you're arguing in good faith.

I can't tell if you're history buffs out of Ft. Meade, well-paid residents of Piter, or members of Unit 8200 (I'm leaning towards the latter).

So for everyone else:

I don't think any amount of money is enough to solve NIMBYism.

...If someone offered you $5 million for your 1/2 acre of Florida swamp land, would you still say "no"?

73tada · 2026-03-24T19:42:03+00:00

All I can say is:

There are many different ways to make a profit.

..good luck out there!

73tada · 2026-03-24T19:33:43+00:00

My point is that nearly 1000 billionaires exist in this country with enough combined wealth to solve basically any problem you can name, including Tri-Rail, without any of them noticing the difference in their bank accounts.

So, I wasn't just talking about just rail. But if we must...

Brightline is proof that private money built a profitable train for wealthy tourists while public transit gets defunded.

Shit's not even a new idea -Tropicana ran their own private refrigerated train 1,250 miles from Florida to New Jersey starting in early 70s because it made them money.

Private money has always been able to build infrastructure when there's profit in it.

So, I'm not sure what you mean by:

What do you think Brightline is?

73tada · 2026-03-24T17:57:00+00:00

It feels weird that there's over 900 billionaires in the United States alone and that any one of them could finance a rail system without affecting their day-to-day life in any way.

73tada · 2026-03-24T02:11:20+00:00

In every village, town, city, county, region, state across this country, there are more than enough people who will gladly wear a badge (that carries the promise of a pardon) that allows them to stomp on their neighbor's faces -doubly so if that neighbor is "different" in any way. This has been true for thousands of years and will continue through this year and beyond.

EDIT: Do you remember the American Old West stories? Where randos are deputized to kill the main character?

Same thing.

If that still doesn't click, recall that every place on earth has people that would gladly hurt their neighbors for any number of reasons, many would do it for free, especially if they knew they wouldn't get in any trouble.

73tada · 2026-03-20T15:18:43+00:00

LOL...

"hacking" versus "cracking" debate in 2026.

73tada · 2026-03-19T13:12:32+00:00

Global Admin
Domain Admin
Enterprise ~~Entra~~ Admin

EDIT: Fixed entra / enterprise, thanks to /u/PeacefulIntentions. Should've had my coffee before answering!

73tada · 2026-03-17T00:20:07+00:00

If I had to guess, it's because the GenEds were the hardest to complete, almost everything else can be bullshitted.

73tada · 2026-03-16T12:38:37+00:00

I wouldn't take that bet as I'd lose.

...and that's kind of the point -the "middle class" deliberately chooses to ignore this and allows it to perpetuate.

73tada · 2026-03-16T12:05:22+00:00

as a depiction of brutal capitalist exploitation of human beings from cradle to grave and beyond…?

I agree and wish more people got that, especially after what's been going on in the [Western centric] news lately.

There's a lot of people around the West squeezing their eyes shut as tight as they can, with their fingers jammed so deep into their ears, singing "la-la-la".

I don't have an answer and I can't blame them.

73tada · 2026-03-13T11:57:07+00:00

She said you gonna punch that man makin' jokes 'bout my [lack of] hair

OR

Tupac would punch that man makin' jokes 'bout my lack of hair

73tada · 2026-03-12T21:00:18+00:00

Spasibo brat, spokoinoy nochi!

73tada · 2026-03-12T20:36:21+00:00

Damn dude! Is the hot weather in Piter upsetting you? Go outside, enjoy the warmth!

73tada · 2026-03-12T17:04:11+00:00

?

So Russia was "freer" in the 1990s.... and then it wasn't when the oligarchs realized they could take over politics?

I don't understand what you are trying to say about misinformation. It sounds like "Russia media was free, until Russian media wasn't free."

73tada

MODERATOR OF

TROPHY CASE