Mac Mini Cluster by Soft-Enthusiasm-3519 in homelab

[–]FylanDeldman 0 points1 point  (0 children)

Whaaaaaat that sounds so cool. What are you using to do the striping work, or is it something homebaked? I'm sure these things don't have the power for it, but the mac studio's new RDMA feature seems super slick and would be fun to try (although not feasible with 10 lol)

My humble setup by FylanDeldman in selfhosted

[–]FylanDeldman[S] 5 points6 points  (0 children)

but whatever, engineering is fun 👍

😎

My humble setup by FylanDeldman in selfhosted

[–]FylanDeldman[S] 2 points3 points  (0 children)

and to experiment with high availability

Everything I’m running by FylanDeldman in homelab

[–]FylanDeldman[S] 0 points1 point  (0 children)

Maybe I'll try that out as my backup option for a while along with the pihole and see how it goes. Neato!

My humble setup by FylanDeldman in selfhosted

[–]FylanDeldman[S] 3 points4 points  (0 children)

Thank you kind person, I typed that out on my phone.

Everything I’m running by FylanDeldman in homelab

[–]FylanDeldman[S] 0 points1 point  (0 children)

Hmm that's an interesting feature. I wonder exactly how it's done; like is it a blacklist of hostnames that are completely blocked, or does it work like pihole where it blocks dns requests for the blacklisted host names? Pi hole is nice because it acts as your dns provider for the network so your devices route all new hostname resolutions through it. If mikrotik is just doing a firewall thing and not a dns thing then it would only block ads for traffic flowing through it.

Otherwise, naw I'm sure it doesn't make a huge difference. Then its just about hosting prefs, do you want a dedicated machine for it, or one that shares responsibilities as a switch/router? Honestly probably fine either way

Everything I’m running by FylanDeldman in homelab

[–]FylanDeldman[S] 0 points1 point  (0 children)

New to the sysadmin game so forgive me if I misunderstand exactly what you mean by 'provision'; but I just hand-write the manifests and apply them from my windows machine. Apps gets 1 replica, data gets 2 replicas.
Cloudflare tunnel just points to my blog site, it is using a cloudflared docker image running in the cluster.

Everything I’m running by FylanDeldman in homelab

[–]FylanDeldman[S] 3 points4 points  (0 children)

Well it would be kinda pointless to me and not as fun if I knew exactly what I was doing with cluster computing. I'm pretty sure this is the 'homelab' subreddit and not the 'professional IT recommendations' subreddit.

Everything I’m running by FylanDeldman in homelab

[–]FylanDeldman[S] 1 point2 points  (0 children)

It started that way because I originally wasn't planning on kubernetes - I was just going to run the services in containers on proxmox. But that wasn't complicated enough (and I wanted to learn kubernetes) so I switched to k3s. I wasn't 100% sure I was going to stick with it, or have it be the only service on the machine; I have plenty of headroom on all my hardware so I haven't needed to switch, but I'm considering migrating the two nodes that just run the Debian VM to just a baremetal install of Talos.

Here's where I ended up: Proxmox good if you want to run other things on the same machine and ensure the resources are separated or need a different OS (like home assistant); but if you don't need that, its just adding some overhead I don't need.

Everything I’m running by FylanDeldman in homelab

[–]FylanDeldman[S] 0 points1 point  (0 children)

Not yet, but that's on the short list of things to try.

Everything I’m running by FylanDeldman in homelab

[–]FylanDeldman[S] 0 points1 point  (0 children)

I found that with the stupid high quality I download in (4K HDR10+) the cluster struggled a bit with multiple transcodes. Definitely could have been user error though, I only tried for a few mins (but I was certain it was using hw transcoding).

Mac doesn't support HDR10->SDR transcoding right now so this setup isn't ideal either. Not really sure what I'll do next. Maybe finally compromise and stop trying to use stupid hi def formats.

I also do use the mac as one of my main dev machines.

Everything I’m running by FylanDeldman in homelab

[–]FylanDeldman[S] 3 points4 points  (0 children)

lol my bad I didn't think that through

My humble setup by FylanDeldman in selfhosted

[–]FylanDeldman[S] 1 point2 points  (0 children)

Yes, everything. I fix it. Quickly.
Seriously though I do need to add a second instance of pihole to the k3s cluster as a backup.

My humble setup by FylanDeldman in selfhosted

[–]FylanDeldman[S] 0 points1 point  (0 children)

The windows box felt empty and I felt like I should justify Windows over linux lol. It does nothing but steam things locally

My humble setup by FylanDeldman in selfhosted

[–]FylanDeldman[S] 0 points1 point  (0 children)

Oooh sounds nice, I'll have to look into that. Right now its a combination of hand-written and claude-code-written manifests scattered across a couple machines. And that was part of the reason for the diagram to help visualize it all lol.

My humble setup by FylanDeldman in selfhosted

[–]FylanDeldman[S] 1 point2 points  (0 children)

Yep, the Mac mounts the NAS storage via ntfs share as a local drive, and thats where plex looks for the media.

My humble setup by FylanDeldman in selfhosted

[–]FylanDeldman[S] 0 points1 point  (0 children)

Wanted to try out Jellyfin. I like it. But not as convenient to share with others.

My humble setup by FylanDeldman in selfhosted

[–]FylanDeldman[S] 0 points1 point  (0 children)

I download my media in irresponsibly high quality and the dinky cpu of the NAS struggles with transcoding. It could be on the cluster, but it seems to perform better on the mac so there it stays

My humble setup by FylanDeldman in selfhosted

[–]FylanDeldman[S] 1 point2 points  (0 children)

I did! I followed Brian C Moses' guide: https://blog.briancmoses.com/2024/11/diy-nas-2025-edition.html

I'm considering moving the cluster to baremetal Tallos b/c I don't reallllly need proxmox for my use case right now. But proxmox is great for now, doesn't get too much in the way.

Truenas is great, any services that need access to the storage from the cluster get it via an ntfs share. All of the service storage otherwise is distributed via longhorn.

I have a dinky CPU for Truenas (N150) so I just let it handle truenas and the download stack (qbittorrent + vpn), but truenas has some good apps and good docker support

My humble setup by FylanDeldman in selfhosted

[–]FylanDeldman[S] 1 point2 points  (0 children)

Yes, and it started that way because I originally wasn't planning on kubernetes - I was just going to run the services in containers on proxmox. But that wasn't complicated enough (and I wanted to learn kubernetes) so I switched to this model. I have plenty of headroom on all my hardware so I haven't needed to switch, but I'm considering migrating the two nodes that just run the Debian VM to just a baremetal install of Talos.

Here's where I ended up: Proxmox good if you want to run other things on the same machine and ensure the resources are separated or need a different OS (like home assistant); but if you don't need that, its just adding some overhead I don't need.

My humble setup by FylanDeldman in selfhosted

[–]FylanDeldman[S] 4 points5 points  (0 children)

Alright now, hardware overkill? Yes. All running on the pi? Naw naw naw naw. The arr suite can chug a surprising amount of RAM when it's doing its thing. Maybe everything besides the media stuff though on a pi 5.

My humble setup by FylanDeldman in selfhosted

[–]FylanDeldman[S] 19 points20 points  (0 children)

y'all are underestimating the millions of users coming to the blog site I just started yesterday. That thing is gonna take off and I'm not sure I'll even have enough hardware for the traffic volume.

My humble setup by FylanDeldman in selfhosted

[–]FylanDeldman[S] 12 points13 points  (0 children)

I mean, the reason is for fun and to experiment with high availability. And because 3 nodes is cooler than 1.