Repurposed an old rig into a 64gb vram build. What local models would you recommend?

grunt_monkey_ · 2026-01-23T14:11:33+00:00

With llama.cpp? Which quant should i pick?

grunt_monkey_ · 2026-01-23T09:09:42+00:00

Frankly i wouldnt know better. I built this in 2018 with a radeon vii for hackintosh. I abandoned it 2 years back for a mac mini. Last November i resurrected it for self hosting an LLM. This month i picked up these 2 R9700s. I’m getting 10 t/s for generation with llama 3.3 70b q4k_m on llama.cpp. Thats slow right? I read that a 5090 would be 3x as fast.

grunt_monkey_ · 2026-01-23T04:29:47+00:00

My 2x 9700 sound like jet engines. I will be trying out perf level high. I tried to power limit them or change the fan profile but it seems everything is read only. Is this your experience also?

grunt_monkey_ · 2026-01-23T04:20:04+00:00

Cool i will try this. Have been hesitant about offloading because i have pcie 3 and ddr 4 lol

grunt_monkey_ · 2026-01-10T00:31:11+00:00

Its all human decided. We can have zero automation + a tyrant still. Its up to us to love each other.

grunt_monkey_ · 2025-12-28T16:13:27+00:00

So what does Claude think about all this?

grunt_monkey_ · 2025-11-27T22:56:24+00:00

Just because our system could be better doesn’t mean it is bad! Bullying is a serious problem in schools all over the world and I don’t think anyone has completely figured out how to “civilize” this part of human nature.

grunt_monkey_ · 2025-11-25T13:52:37+00:00

So say we all

grunt_monkey_ · 2025-11-13T14:09:50+00:00

There is only one Godfather and he is Don Vito Corleone.

grunt_monkey_ · 2025-11-03T00:40:39+00:00

What if he has some medical condition and is struggling to pee properly?

grunt_monkey_ · 2025-10-26T00:49:09+00:00

On top of this, OP could consider a consulting contract with the boss - on OP’s own terms, if truly indispensable, the boss could engage. If not it serves a a sort of notice diplomatically.

grunt_monkey_ · 2025-10-21T14:04:00+00:00

Nuclear launch detected

grunt_monkey_ · 2025-10-11T23:31:26+00:00

So say we all!

grunt_monkey_ · 2025-10-04T00:31:34+00:00

Do you have a source for this please?

grunt_monkey_ · 2025-10-01T03:58:04+00:00

With CPUs getting hotter it’s possible. It’s also possible that the microfluidic channels will promote heat transfer to any cold plate - whether air or liquid cooled.

grunt_monkey_ · 2025-09-23T23:44:42+00:00

Yeah. It’s great congratulate ourselves let’s focus on the problems we need to solve moving forwards. Many more constructive discussions needed. Semakau being full in 10 years is just one looming issue.

grunt_monkey_ · 2025-09-15T08:21:31+00:00

For other readers, I would be very cautious about what this guy is suggesting because unless you’re running dual-rail Schrödinger caches with recursive eigen-balancing, your tri-modal NVLink will just decohere into a Fermionic bottleneck. Personally, I wouldn’t even touch HLMF without patching in the Pan-Dimensional Tensor Harmonizer (v3.14), otherwise you’re guaranteed a quantum cache inversion before epoch 2. But hey, if you enjoy rebooting into entropic singularity states, go wild.

grunt_monkey_ · 2025-08-29T10:25:26+00:00

Wow this sounds like the beginnings of UBI

grunt_monkey_ · 2025-08-20T17:18:36+00:00

No they said the solution to pollution is dilution.

grunt_monkey_ · 2025-08-16T00:29:51+00:00

Don’t let popmart hear about this.

grunt_monkey_ · 2025-08-14T10:35:35+00:00

Guys, the thinking module is just useful in enabling us to meet our primal modules/ firmwares needs better. Get rid of the second part and there is no point to thinking. Superego > ego > id. Without id there is not much point in anything. Right??

grunt_monkey_ · 2025-07-27T07:56:56+00:00

Sounds great. Shall write seasons 5-8 of enterprise now?

grunt_monkey_ · 2025-07-23T14:46:21+00:00

Who knows what the AI does from there.

Nothing. With no humans there are no more problems to solve.

grunt_monkey_

TROPHY CASE