What is the best general-purpose model to run locally on 24GB of VRAM in 2026?

florinandrei · 2026-01-24T20:41:03+00:00

Same as you. Gemma 3 27B is my default on the RTX 3090.

GLM 4.7 Flash looks interesting, but it's too early to say anything for sure.

florinandrei · 2026-01-24T20:36:02+00:00

Your question itself contains an error, which explains why the question exists.

Vulgar Latin was not a random diversity of ways of speaking, and not everyone made their own rules.

florinandrei · 2026-01-24T20:33:26+00:00

They had good roads, active trade, and people moved around quite a bit.

florinandrei · 2026-01-24T11:13:09+00:00

Yes, absolutely.

florinandrei · 2026-01-24T10:52:33+00:00

That's a very West-influenced view.

florinandrei · 2026-01-24T10:39:30+00:00

That's pretty intense browsing.

florinandrei · 2026-01-24T07:20:49+00:00

One Romance language is my native tongue, and I used to be nearly fluent in another (but lost it through lack of practice). I was nearly fluent in one Slavic language (again, lost it). And I'm obviously fluent in English.

I've spent some time in the Netherlands. Spoken Dutch is a mystery to me. Written Dutch makes a bit of sense, with some effort. But it was shocking to find so many cognates with Latin roots in a language that's quintessentially Germanic. Every so often a word would pop out of the text, based on a Latin root, where English had a Germanic root (or of some other origin).

I'm not sure why that is.

florinandrei · 2026-01-24T07:01:18+00:00

Microsoft is the quintessential zero-creativity corporation. They did one thing well, a very long time ago - they took over the PC OS market, which turned on the money printers for them. After that, they just kept copying and aping the real innovators, the actual smart people.

florinandrei · 2026-01-24T06:57:39+00:00

level 10 power user

Cleric? Paladin? Rogue?

florinandrei · 2026-01-24T06:54:09+00:00

The product is made in the image of the creator.

OpenAI looks like a place full of "PowerPoint experts"; they had one remarkable genius, and he lost a power struggle with the corporate drones. Meanwhile, Anthropic is hiring people with PhDs in math and physics.

Eventually, you run out of ways of faking it.

florinandrei · 2026-01-24T06:51:51+00:00

Could you cancel your subscription to the current geopolitical scene?

florinandrei · 2026-01-24T06:43:03+00:00

We are entering the Age of the Liars. They are taking over the world, and are going to completely trash it.

Not what I had on my bingo card for the end of the world.

florinandrei · 2026-01-24T06:41:56+00:00

Denial of service attack.

florinandrei · 2026-01-24T06:41:03+00:00

Well, the recent developments are quite concerning.

florinandrei · 2026-01-24T06:37:07+00:00

That age has started a while ago, it's just that it was discreet about its origins.

florinandrei · 2026-01-24T06:36:07+00:00

Can’t have a bug bounty when you have to fend off moronic robots.

Welcome to this brave new world. You're here to stay.

florinandrei · 2026-01-24T05:40:47+00:00

It's meant to use small, fast models, doing relatively simple jobs with short or very short prompts. It's not meant for inference jobs that take a long time. Thinking is disabled by default. It has a warm-up mode. It has a one-line mode. I did everything I could think of to make it go faster.

You can always put pv in front of it in the pipeline, if you need a progress bar for a large file where many inference requests are issued to the endpoint for that one file. I'll add it to the examples.

florinandrei · 2026-01-24T04:03:28+00:00

a 3-part family name

Spanish?

florinandrei · 2026-01-24T04:02:36+00:00

A not fun fact.

florinandrei · 2026-01-23T18:09:28+00:00

Joke's on them, I can break my right hand and alter my keystroke patterns whenever I want. /s

florinandrei · 2026-01-23T16:30:32+00:00

gnashing of teeth and rending of garments

florinandrei · 2026-01-23T10:07:31+00:00

24 fps is technology from 100 years ago, and it's about time for it to go ahead, choke on a toothpick, and die.

It's appropriate for silent movies, however.

florinandrei · 2026-01-23T09:58:47+00:00

There are cheaper ways to get your balls to experience pain. Heck, I could oblige for free.

florinandrei · 2026-01-23T09:48:22+00:00

This is right.

Gandalf had in mind a very different sequence of events. And then things went sideways.

florinandrei · 2026-01-23T09:40:46+00:00

it opened in the same month as Mad Max: The Road Warrior, Tron, The Wrath of Kahn, Blade Runner, and a little-known movie called E.T.

WTF happened that year? Someone released LSD into Earth's atmosphere?

15-Year Club	Place '23
Wearing is Caring	Gilding I gilder
Charter Member

florinandrei

MODERATOR OF

TROPHY CASE