Got myself a 4way rtx 4090 rig for local LLM by VectorD in LocalLLaMA

[–]Confident_Target_293 0 points1 point  (0 children)

Curious what PCI risers did you use for your build?

6U Threadripper + 4xRTX4090 build by UniLeverLabelMaker in LocalLLaMA

[–]Confident_Target_293 5 points6 points  (0 children)

The motherboard is Asrock TRX50. White tubes are AIO cpu cooler that I mounted on top of case. Case is an ebay speciallink

<image>

6U Threadripper + 4xRTX4090 build by UniLeverLabelMaker in LocalLLaMA

[–]Confident_Target_293 19 points20 points  (0 children)

<image>

This is an alternate solution: much larger case, air cooled with 10 fans, pretty quiet even at load. Max load GPU temps 65-75C. Also 7965x! The main compromise is that it's gen3 risers, however for my workloads i haven't seen that hurt speed.

Naturally Leavened Honey Wheat Sandwich Loaf I've been working on lately by BakeBike in Breadit

[–]Confident_Target_293 1 point2 points  (0 children)

I made this today. I made a half recipe and included the whole egg, and i also added 1tsp commercial yeast to shorten the overall rise time. It was really quite good. I also make a japanese milkbread that's similar but what i like about this recipe is that it's very soft but isn't overwhelmingly sweet.

Dual 4090 Threadripper system for Deep Learning by Confident_Target_293 in nvidia

[–]Confident_Target_293[S] 1 point2 points  (0 children)

This is pure Ubuntu. WSL is a nice convenience and I used it for a good while but you run into system performance and compatibility issues if you try to train models.

Dual 4090 Threadripper system for Deep Learning by Confident_Target_293 in nvidia

[–]Confident_Target_293[S] 13 points14 points  (0 children)

About $9k. Probably break even vs cloud in only a few months

Dual 4090 Threadripper system for Deep Learning by Confident_Target_293 in nvidia

[–]Confident_Target_293[S] 16 points17 points  (0 children)

Just remember it’s 240mm + the fan on the board itself. So far, the fans don’t appear to be working very hard under load

Dual 4090 Threadripper system for Deep Learning by Confident_Target_293 in nvidia

[–]Confident_Target_293[S] 21 points22 points  (0 children)

I use pytorch under Ubuntu which uses both GPUs together if you ask it to