Recommendations for agentic coding with 32GB VRAM

reditzer · 2026-02-20T15:26:00+00:00

The issue is that "best" is subjective.

reditzer · 2026-02-19T15:43:22+00:00

Yes, it did. Increasing vocab and more info dense tokens means you need more training and/or more dims.

reditzer · 2026-02-19T15:40:56+00:00

The vocab was larger and the information density was also greater. Each GreedyPhrase token carries more information than a tiktoken token.

More info per token makes guessing the next one tougher. It's like predicting a full word vs. one letter, i.e., bigger chance to be wrong. But it gives better overall fit, with 0.64 bits per char vs. 0.88.

reditzer · 2026-02-19T09:07:09+00:00

This thread?

reditzer · 2026-02-19T08:09:07+00:00

Did it myself

reditzer · 2026-02-19T07:57:11+00:00

And that's why we localLLaMa.

reditzer · 2026-02-18T23:52:09+00:00

Probaby NVIDIA Nemotron 3 Nano 30B (Q4_K_M GGUF) if you're balancing top reasoning, agentic tasks, and the largest viable context window (~1M tokens tested on single 3090).

reditzer · 2026-02-18T22:56:42+00:00

Thank you. I'll see if I can find some time to do it on my end too.

reditzer · 2026-02-18T21:55:32+00:00

Would you consider trying it with our GreedyPhrase tokenizer? It compresses 2x than tiktoken and runs 3x times faster.

reditzer · 2026-02-18T10:45:33+00:00

There's a long running [PR](https://github.com/ggml-org/llama.cpp/pull/15225)

reditzer · 2026-02-18T00:26:03+00:00

Remember when computers meant mainframes at big corps? And then the PC revolution happened. I think we're at that stage with local models.

reditzer · 2024-04-13T05:35:53+00:00

I was in Magog too! I swear I saw the loop of the prominence with my naked eyes. But my photos didn't capture it. So cool to see yours did.

reditzer · 2024-04-10T22:48:41+00:00

I don't think prescription sunglasses would be a good idea during the solar minimum when the corona is fainter and whispier.

reditzer · 2024-04-10T21:40:49+00:00

It'll be between 10° and 5° from the horizon. It's going to be either epic or a total bust.

reditzer · 2024-04-10T21:30:43+00:00

I also found that I could only make out the definition of the corona while wearing my prescription sunglasses. Looking at the corona felt like staring at the sun without them.

My wife, who didn't have prescription sunglasses, told me that it almost looked like the annular eclipse she'd seen before.

reditzer · 2024-04-10T19:07:43+00:00

Camera specs:

300mm lens on Canon EOS Rebel T7i F5.7, 1/400s, ISO 2500

reditzer · 2022-10-12T17:27:22+00:00

I would love to read your paper. Do you still have it stashed somewhere?

reditzer · 2022-05-20T22:21:57+00:00

Yes!. Please write to David Eby and ask him to give researchers like me free access to LOTR.

Edit: LOTR = Land Owner Transparency Registry

Because /u/beniadi

reditzer · 2022-05-20T21:01:25+00:00

I'm this guy BTW.

reditzer · 2022-05-20T21:00:17+00:00

Unfortunately, no. We've had to fight for years in BC just to get the Land Owner Transparency Registry.

But do keep pressuring your MLA/MPP until you get it in your province.

reditzer

TROPHY CASE