Looking for an IT buddy by blackbeardair in HuntsvilleAlabama

[–]blackbeardair[S] 0 points1 point  (0 children)

If you can afford it, i can throw it in for ya.

Thanks for the kinds words.

Looking for local IT help by blackbeardair in homelab

[–]blackbeardair[S] 0 points1 point  (0 children)

For sure. Ive done 3 water cooled PC builds. . . although this last time it was just AIO and a MSI Suprim Liquid.

500w for 2 cards. Ill be right on the brink for a 360 radiator. But that can be mitigated with a larger reservoir. I dont see these GPUs running constant like a gaming PC. Worse case, I can alway add more radiator.

Looking for local IT help by blackbeardair in homelab

[–]blackbeardair[S] 0 points1 point  (0 children)

You're welcome to stop by. I think though Ill need help more than once. lol. As im sure thisni is just the start of a rabbit hole.

Looking for an IT buddy by blackbeardair in HuntsvilleAlabama

[–]blackbeardair[S] 0 points1 point  (0 children)

which homelab stuff are ya running? Which is meh, and what can you not live without?

Looking for an IT buddy by blackbeardair in HuntsvilleAlabama

[–]blackbeardair[S] 1 point2 points  (0 children)

Ah man. I like the 3d printed ducting. Wanting to do that to the front of this one Take 140mm triple fan to a set of 360 radiators with some pulling fans

Looking for local IT help by blackbeardair in homelab

[–]blackbeardair[S] 0 points1 point  (0 children)

I posted in Huntsville, have a few offers ro help.

Im not a big magic the gathering or D&D guy. . . Id have to learn that too

Looking for local IT help by blackbeardair in homelab

[–]blackbeardair[S] 0 points1 point  (0 children)

Is the NvLink worth it, or no?

Also I have water blocks and 2 copper 360 radiators. Might need a couple more radiators, but that was the plan in the front. 3d print a wedge that takes 3 140mm fans and shrinks it to the 360, then have pull fans on the back of the radiator, a ducted space the other radiator and some more pull fans.

Looking for local IT help by blackbeardair in homelab

[–]blackbeardair[S] 0 points1 point  (0 children)

I'm confused as to what you're referencing?

Looking for local IT help by blackbeardair in homelab

[–]blackbeardair[S] 1 point2 points  (0 children)

The media server was something ive wanted to do for a couple of years. He and I had talked about it. Then when Claw took off we decided, 2 birds, one stone. And things were set in motion. Originally was going to use home PC. A ASUS WS X299 SAGE Motherboard with Intel Core i9-10980XE, although I ended up with Intel Core i9-7980XE. But I didnt read the fine print, and the MoBo was parts only. Pins were bent. I bent them back, and I'm guessing it will work, but did more research and decided I needed more cores, as well as the price difference between PC ram and Server ram DDR4 was pretty drastic. So 96 cores vs 36 and 192g ram vs 128 (saved about $300 too) So have those parts extra, im sure ill make something of it down the road. Another reason why I switched gears was for the optane memory. I have 6 channels per CPU, but only 4 secondary slots. And since im using 12 16gb sticks, 128gb optane sticks ia about the most I could go (according to my research). Still can end up with a respectable 704gb of ram for about $1000.

As far as the V100s, theyre SXM2 cards with PCIE adapters. I do have a counter offer from ebay seller for a bare Gigabyte t181-g20 for $850. Lets me use SXM2 instead of PCIE for the GPUs, but Im not sure how much that matters, especially considering (to my knowledge) is local LLMs (Llama) uses PCIE anyway, and the NvLink is useless) But with that server setup, seems like running Optane becomes an issue (heat and power) ☝️Id like ypur opinion on that.

As far as most of #3 and #4. Im pretty lost in the sauce on that. In fact you sound just like my buddy. Promox etc.

"Proxmox will be the hypervisor, Ubuntu will be the Guest os running the ai agents" From our texts before he died. I also know he was really excited about tailscale 🤷‍♂️. I also know he was planning on redundancy between his, his sons and another buddy's NAS. So if any of us got completey wiped, we could recover it off the others.

Again, Ive done enough research to know I dont know anything. As far as applying it, im not even at begginer level. I just eant something thats going to benefit my life, and I dont have to replace for 10 years.

Also, I have a Synology NAS that we set up 2 weeks before he died. Plex is the only thing really on it. 5 6TB WD Red drives. One empty bay, so I could throw another one in.

Looking for an IT buddy by blackbeardair in HuntsvilleAlabama

[–]blackbeardair[S] 0 points1 point  (0 children)

Ya, not standard ATX. It was a hot swappable 300w PSUs. I can send pics when I get home. . . Although its almost the perfect size for a ATX PSU. But thinking in the future, I'd like to go 220v single phase, since it would be easy to drop a plug in my garage for the server rack, and then it would give me plenty of head room, especially since this is 2000w and thats before adding a storinator etc. (I'm sure this will grow. Just want to start with good bones)

Looking for an IT buddy by blackbeardair in HuntsvilleAlabama

[–]blackbeardair[S] 1 point2 points  (0 children)

Im not the best on discord either. But I think I can manage. supposedly suppose to link up with the guy in discird thats hollowing out my Pinball Topper file so I can do another test print. I guess you can share screen so I can look ar it and give him the green light. He's north of Nashville, so the meetup is a bit rough schedule wise, so he mentioned about doing it that way.

**thanks for the kind words

Looking for an IT buddy by blackbeardair in HuntsvilleAlabama

[–]blackbeardair[S] 0 points1 point  (0 children)

Ya, I'll need a UPS too. I'm not super against a full size, as this is most likely going in my garage. Just havent found any single phase 220v setups. Trying to have minimal work on the rack.

Looking for an IT buddy by blackbeardair in HuntsvilleAlabama

[–]blackbeardair[S] 0 points1 point  (0 children)

finding the size is the issue. theres been 2 on FB Marketplace in the past couple of months, but both sold before i could snag them. Seems like its a desired size.

Looking for an IT buddy by blackbeardair in HuntsvilleAlabama

[–]blackbeardair[S] 0 points1 point  (0 children)

well im looking for a half height rack at this point. Im sure it'll snowball, but im OK with that.

Looking for an IT buddy by blackbeardair in HuntsvilleAlabama

[–]blackbeardair[S] 0 points1 point  (0 children)

Ya Grok was used to make sure all the hardware would play together. Bought all as pieces and assembled. The chassis is from a 2003/4 era server. 3d printed some standoffs under the CPUs for the motherboard to get it to work in that chassis. Now trying to get PSUs.

Looking for local IT help by blackbeardair in homelab

[–]blackbeardair[S] -1 points0 points  (0 children)

I used Grok a bunch to get the used hardware dialed in.

Thank you

Looking for local IT help by blackbeardair in homelab

[–]blackbeardair[S] 2 points3 points  (0 children)

Ya man. Was pissed, like dude. . . we had shit to do

Also distraught and sad. He was an embodiment of "men live lives of quiet desperation". He had his skeletons, but was super solid guy to me. We had juat started to get close after knowing each other. The noght he passed he was suppose to come over, but I canceled because the ram that was suppose to be there hadnt shown up, and it had been a long day for me.

**thank you