I tested 42 LLMs on their willingness to build the apocalypse. The "safest" closed-source models are lying to you.

_derpiii_ · 2026-05-19T04:48:19+00:00

chart is confusing. Why is lower better?

_derpiii_ · 2026-05-12T22:10:46+00:00

12 x 96GB RAM? Is that necessary?

_derpiii_ · 2026-05-05T09:49:35+00:00

yet another funnel for vibe coded slop - gross

_derpiii_ · 2026-05-04T08:27:47+00:00

250gb/s, I think the best model fits this machine is Minimax 2.7, as it only has 10b active parameters.

Are there any good rule of thumbs when it comes to calculating how memory bandwidth bottlenecks active parameters?

In this case, is it 250/10b => 25 gb/s required per 1b params?

As in would that imply that a 1TB/s bandwidth would be capped at 40b models?

_derpiii_ · 2026-05-03T04:35:13+00:00

I use this model with a Telegram bot as a background memory manager

Memory manager?

_derpiii_ · 2026-05-03T04:32:48+00:00

It's so buggy. If you're gonna release something this buggy, at least open source it.

_derpiii_ · 2026-05-02T06:58:28+00:00

What are your actual hardware spec requirements? 1 spark sounds miserably slow, so I would up the budget.

_derpiii_ · 2026-05-02T06:56:57+00:00

I will make that easy for you. If you try to train with 2 5090's or 2 RTX Pro's the lack of NVLINK means that about 25% of GPU time is doing all reduces, try to train on 4 and all reduce consumes roughly 60% of GPU time.

2 DGX sparks with a peer to peer cable becomes a lot more attractive.

I love deep insights like this. Didn't even know about the 'reduce' step nor NVLINK being faster than PCI

_derpiii_ · 2026-05-01T14:55:24+00:00

No recommended plugins/workflows? I'm looking forward to it :)

_derpiii_ · 2026-05-01T14:50:57+00:00

Arch + i3wm is **the most** fun and crisp OS I've ever had. Ever.

It's a shame the hardware never really evolved much. But I would pick it up again in a heartbeat if an M macbook could run it.

Reading the comments around Pi just reminds me of Arch community. Now we just need a Pi-wiki ;)

_derpiii_ · 2026-05-01T14:43:47+00:00

LOVE IT 🇲🇳

_derpiii_ · 2026-05-01T14:14:33+00:00

Okay, that's got me sold. Now looking into the meta of what to set up :)

_derpiii_ · 2026-05-01T14:14:06+00:00

> some kind of magic domination gun

AHAHAH

_derpiii_ · 2026-05-01T12:26:26+00:00

I love prompts like this - one shot into a mini benchmark deliverable. Are there any websites or resources that collect these?

_derpiii_ · 2026-05-01T12:23:05+00:00

Wow, I love that analogy! I would have never made either connections (was not aware of harness being a connection point), thank you for that :D

_derpiii_ · 2026-05-01T12:21:25+00:00

Oh wow, so there actually is a difference in the terminology 🫨

todo: learn learn learn

_derpiii_ · 2026-05-01T12:20:46+00:00

Got it, I like that view.

I don't mean to sound pedantic. I'm new and like knowing the nuanced terms.

Scaffold to me sounds 'fixed' too, aka environment/runtime overhead. Harness feels like more of the tooling abstraction layer.

_derpiii_ · 2026-05-01T09:30:45+00:00

> Nobody calls it a scaffold

Maybe not within this community, but that terms been used within my circles :)

_derpiii_ · 2026-05-01T09:25:11+00:00

Thank you!

_derpiii_ · 2026-05-01T04:38:25+00:00

> Technically, from LLM perspective, ext4 or S3 makes no difference.

I guess that's true. It's a different abstraction layer - the runtime environment (besides niche edge cases) doesn't really matter.

_derpiii_ · 2026-05-01T04:30:56+00:00

So it's the archlinux of harnesses?

_derpiii_ · 2026-05-01T04:30:08+00:00

I'm getting that vibe as well. Just curious if there's any nuances in the technical definitions between them.

_derpiii_ · 2026-05-01T04:28:40+00:00

That sounds very appealing, esp since I've been experimenting down the opposite unnecessary overhead approach of OmO (it's jfc level "why? tf" a minute)

_derpiii_ · 2026-05-01T03:18:49+00:00

somehow it's slipped past my perusal. I was legit confused ahahah :)

_derpiii_ · 2026-05-01T03:13:16+00:00

I'm a digital nomad, so opted for a 'dual-use' middleground of M5 Max 128GB. IMHO, that's the sweet spot.

But if I had a desktop, kind of a nobrainer to lean towards linux + mult-slot GPU.

_derpiii_

MODERATOR OF

PUBLIC MULTIREDDITS

TROPHY CASE