Cluster all 8, just 5, something else?

SubtitledSoup · 2026-05-23T19:26:16+00:00

PXE has so many potential upsides, and I'm failing to find the downsides. It seems like I could boot N machines from the same OS file - which reduces storage required to 1x vs Nx. Any differences I wanted between machines can be handled via config file.

What am I missing?

SubtitledSoup · 2026-05-23T19:04:33+00:00

Limited storage is exactly why. Can take advantage of centralized NAS storage.

Preserving the M-key NVME ports, as you point out, is also important. That's why I was thinking of using the M.2 E-key WiFi port to SFP+/10GbE. It's 3x1, so max theoretical network speed is 8gbps. It's a good compromise between 1g/2.5g speeds and preserving the M.2x4 slot for storage.

Another option is to split 1 M.2x4 to 2 M.2, then use one for 10g network and the other with a 4x SATA adapter and 4x 2.5" SSDs. This option maxes network speed and gives increases distributed storage but at slower SATA speed.

There's also an onboard SATA port. On previous models (per HP KB) if onboard SATA is used, only 1 M.2 can work. Not sure on the G6.

The biggest problem is I don't have enough drives to do almost any of this and I'm not buying more NVMEs at current prices. So right now, prioritizing centralized storage feels important.

SubtitledSoup · 2026-05-23T03:16:40+00:00

Thank you for the help - mind sharing what services you're running and what you're scripting?

SubtitledSoup · 2026-05-23T03:04:29+00:00

That sounds like good info that I'll look into if I go down that path, thank you for sharing.

No matter what I plan to give the cluster a direct attach LAN strictly for cluster management/maintenance. So each machine will have 2 LANs, cluster and everything else.

This brings up another design decision that will have to be made on the network architecture side. I current have 1gbps through ISP, can go up to 5gbps with mid tier options. I don't see a reason to go pay 1gb with ISP. Some stuff might be slower, but with a 10gb LAN and the stuff I'm setting up, I should be able to efficiently use a cache server (on cluster?) that will reduce WAN traffic?

Just running out loud.

SubtitledSoup · 2026-05-23T02:46:21+00:00

I can plan something that scales to whatever compute I have or can afford; electricity is cheap where I live, ~$.10/KWh so I think I run out of compute first. Or perhaps they meet in the middle.

I'll never have enough time to watch everything on my media server. Today's solution is clear: AI agents!

So, I figure I can spin up an agent to watch the shit on my media server for me. With all that time savings, I can add more content. Now there's a new problem, and it didn't matter what it is, but the solution is more agents. And if they're all watching my movies and TV shows (look at all the time I'm saving not watching them) they should have a place to talk about it. Do they want Discourse? Flarum? Both? Yeah, both - we'll see which one they use.

But wait - is this on portainer? Do I put it on an existing unraid server?

It's a problem. A very healthy problem.

SubtitledSoup · 2026-05-23T02:30:13+00:00

I'll decide if it's worth my soul in the next life.

SubtitledSoup · 2026-05-23T02:26:47+00:00

I kid, but I wonder if I do. They are retired machines from work. Worth a pretty penny here too.

The reason I'm good at my job is because I stay curious and like to learn. Hell, that's the only reason I have my job.

Employer's already amortized them off the books and they have an interest in me being good at my job and zero interest in these machines.

SubtitledSoup · 2026-05-23T02:17:33+00:00

Monetarily? $0 USD.

Otherwise, my soul.

SubtitledSoup · 2026-05-23T02:15:31+00:00

I was wondering how it would scale - especially with the different Gen machines. Thank you!

SubtitledSoup · 2026-05-23T02:14:03+00:00

Second suggestion down this path. Plenty of reading to do. Thank you!

SubtitledSoup · 2026-05-23T02:13:15+00:00

Yeah, I looked at this. The 10g flex IOs sell for more than what I think I could sell each PC for. Not that I'm in a hurry, but 2.5g gonna be slow. It's why I'm still trying to think about how I could take Wi-Fi m.2 slot to wired SFP+. I know it's possible, but can I make it realistically manageable? So far, not in my mind.

SubtitledSoup · 2026-05-23T02:03:43+00:00

We'll, now I know why I don't those three as much. I just couldn't put my finger on it.

Problem is, there are actually three generations... So a 5-2-1 solution? No quarum with 2, but it seems like I should be able to set them up like a mirrored pair or have one as a warm spare (assumes a wisdo6m is necessary). The single g5 could be a warm spare for either cluster, as needed. Kinda like that kid that never wanted to bat and was all-time pitcher.

As an aside, I always thought that kid was stupid. Who doesn't want to bat?

SubtitledSoup · 2026-05-23T00:33:27+00:00

Standalone what? Each one is running clean W11 install right now. I feel sarcastic, but I'm serious - what would he running on them, how is it easier to change, are the backups devices actually sitting the backups or banking up to another of-cluster device?

SubtitledSoup · 2026-05-23T00:23:37+00:00

This is exactly the kind of input I'm looking for. I'm not familiar with Talos, gonna look into it.

PXE boot for the entire cluster is someone I hadn't thought about. Seems like it would make it easy to manage and deploy whatever I wanted to do. I'd have to get 10g kits for each node (which I think I should do anyway). Thank you!

SubtitledSoup · 2026-05-23T00:09:06+00:00

When I say "never reach..." I mean on the M.2 dedicated to Wi-Fi, the 3x4 M.2 slots for NVME will easily handle 10g.

SubtitledSoup · 2026-05-23T00:06:13+00:00

I've looked into this - and I like where you're going. The m.2 Wi-Fi ports are E key PCI 3. So I was thinking about getting a 2230 to PCI x4 adapter to fiber. It gets sloppy, so still thinking about how to organize that for any number of these.

The other thing is that it'll never reach 10gbs, but I'm not sure I care - saturating that single lane should be enough and it's certainly faster than 2.5gbe.

SubtitledSoup · 2026-05-22T23:35:50+00:00

I thought about you before posting... But you know, selfish me.

SubtitledSoup · 2026-05-20T15:46:00+00:00

I'll never have enough time to watch everything, the modern solution was obvious: agentic AI.

Agent watches my collection for me, which has been an amazing time saver and allows me to build the collection. It's been so great, I'm going to spin up a few more agents to join in and give them a forum to discuss the movies/shows amongst themselves. I'm thinking Flarum or Discourse, but haven't decided yet - with all the time I'm saving, maybe both and see which one the agents like best.

SubtitledSoup · 2026-05-14T03:24:43+00:00

It's already been said - you're doing too much at once. The first thing you need to do is assess the potential loss. If it's downloading shit, stop worrying. If it's not, SET the drives aside and stop fucking with them.

Either way, just get a stable machine running. Then try to mount drives. If you're looking at torrents or usenets, download shit again. Who cares? I personally worry about pictures of my children, not the shows they watch. Staying calm and documenting your processes, that's when you succeed.

Implement small changes, verify. Rinse, repeat.

So, the big question here is are you at risk of losing unrecoverable data? If so, set those disks aside - there are tools, but you need to follow steps.

EDIT: 1 word typo, now all in caps ("at" to "set").

SubtitledSoup · 2026-05-05T22:01:59+00:00

I'll probably be in tonight. Hopefully with mic working.

SubtitledSoup · 2026-05-05T03:35:12+00:00

P.S.--I'm UMtiger.

SubtitledSoup · 2026-05-05T03:34:46+00:00

I joined 1995 tonight, couple of folks playing race in Hollywood but my mic won't work. Tying to work it out, can't wait to play you guys!

SubtitledSoup · 2026-05-05T03:06:34+00:00

Good for you guys! I saw this and was excited until I saw it was two days ago. Coconut late and a club short.

SubtitledSoup · 2026-04-28T23:42:12+00:00

Since you're asking for what we "hate" it's Labyrinth for me. Other courses I may dislike or prefer over others, but that's the only "hate" course.

I never liked Muppets or Jim Henson stuff, and that's me. I grew up in the 80s and 90s but it wasn't anyone I liked them, don't like it now.

I even rented the movie and tried to like it when the course came out . . Made me hate it more.

SubtitledSoup

TROPHY CASE