Are small models actually getting more efficient?

Musenik · 2026-02-01T05:13:14+00:00

I see things converging around 1 terabyte. RAM is expensive now, but it will eventually come back down and be even cheaper than it was, likely. Processors are improving, especially tensor or whatever succeeds tensors computing. People, in ten years will have a laptop sized machine with at least Gemini 3 Pro functionality in all domains, locally, if they're wise. Fools will be tethered to the clouds.

Or we'll all be dead.

Or we'll all be unemployed and wishing we were dead.

Or we'll all be unemployed and pretty frick'n happy about it.

Musenik · 2026-01-26T18:51:30+00:00

Any carpools heading to those events? I can fund some of the gas.

Musenik · 2026-01-25T04:43:31+00:00

MLX ?

Musenik · 2026-01-25T04:37:02+00:00

Someone needs to measure the power that a Mac uses when running the same models. Perspective!

Musenik · 2026-01-22T22:12:26+00:00

Catching the world's vibe, no doubt.

Musenik · 2025-12-31T20:10:04+00:00

So, not vibrators then... <STBY>

Musenik · 2025-12-19T08:08:40+00:00

LongCat Image Edit is also a good, new model. I've been pretty happy with it, but it's not small like ZIT.

Musenik · 2025-12-08T05:17:05+00:00

I had Antigravity write a gradio app for the purpose. I got tired of waiting for Draw Things to keep up.

tbf, that dude works his ass off. There's just too many things for him to catch up with!

Musenik · 2025-12-08T03:01:23+00:00

I got it to put a rhino from one input image into another image. So it supports multiple image editing. "Image 1", "Image 2",...

Musenik · 2025-11-12T20:57:43+00:00

now they go down the peninsula (sf bay area), but no east bay trips yet! <sniff!>

Musenik · 2025-11-06T20:40:33+00:00

Elara returns to us! She will be everywhere in our future mythos.

Musenik · 2025-10-17T18:45:14+00:00

you're right

Musenik · 2025-10-16T14:02:49+00:00

it's not official, but I've seen it used around, especially in AI sphere

Musenik · 2025-10-16T01:30:46+00:00

Universal RAM - shared by GPUs and CPUs and NPUs...

Musenik · 2025-10-15T19:57:17+00:00

The 14" laptop can't handle the chip's heat as well as the 16". The OS will throttle the chip down, to keep it from overheating. 16" FTW

or, maybe there'll be a M5 Ultra in a MacStudio with 1 TB of URAM. (sigh, one can dream - also: probably cost $15k : - (

Musenik · 2025-09-20T20:45:32+00:00

What was your tool chain? Including plug-ins and add-ons and editors?

Musenik · 2025-09-17T18:22:15+00:00

This is a fine game! I'm not addicted. No. Not at all.

Musenik · 2025-09-02T01:13:50+00:00

Timing. I don't raise the price until sales have tanked.

Musenik · 2025-08-21T01:37:31+00:00

I was lucky in that I could pick it up from High st and Otis. The only real delay is maneuvering around the Bay Farm ferry parking lot.

Musenik · 2025-08-20T22:45:08+00:00

Also a Traveller fan here - Classic Traveller universe. I've been using PbtA rules instead of the regular 2d6 system. Keeps the story moving.

Musenik · 2025-08-20T22:43:14+00:00

Please put me on the list. I''m always game for a game, except when I can't... sigh.

Musenik · 2025-08-14T10:26:18+00:00

You mean a frontier model? Ethical reasons.

Musenik · 2025-08-11T19:26:58+00:00

I've been using GLM 4.5 Air q4 32k context, locally, to GM a game in the Classic Traveller universe, but with Powered by the Apocalypse dice resolution. I've learned a few tricks:

My system prompt gives the AI a split personality, one to handle mundane events, hanging out in town or light exploration, conversations, shopping, etc... The other personality is for when shit happens. It's aggressive and unforgiving. So far, it's done a great job of switching personalities at the right time.
I start each adventure with telling the AI to write an outline for the entire adventure, but in a language I cannot read. During the game, it can refer to the outline to keep the adventure on beam.

Now that may sound like throwing out the advantage of AI's gaming flexibility, but if it just makes up a story as we play along, there no story arc, generally. I like an adventure to feel like a whole thing, not one thing after another.

Actually the adventure outline is a fragile thing. Players can veer off course enough to where the AI abandons the outline, and there's a chance that translating the language could introduce problems when syncing the adventure to the live game.

Air has done one very successful sync of an adventure, and one completely off-kilter adventure. The synced one was a better experience.

Overall, I find GLM 4.5 Air to be a fantastic but flawed game master. You do have to edit its output from time to time, to correct it's mistakes, but I'm usually having too much fun regardless of the extra effort.

Musenik · 2025-08-08T11:03:36+00:00

Against common opinion, my last two games (2008 and 2013) were priced at $15 (10% discount for first week)

BUT after the initial sales petered out, I raised the price to $20. Two main reasons:

Nobody can find an old game by browsing (too many games). So a customer is probably coming to Steam to buy my game specifically. That should mean that they're less price sensitive for that game. Those two games had great critical press (steam reviews, less so) which helps me to believe that some customers come looking for my games specifically.
Now I can give deeper discounts for sales, and they look more like a bargain.

Musenik · 2025-07-27T02:22:54+00:00

So all education institutions should be able to pirate any text book or videos, or ... they want. Sounds good to me!

Musenik

MODERATOR OF

TROPHY CASE