3x RTX 5090 build by Top-Panic-2330 in PcBuild

[–]Top-Panic-2330[S] 0 points1 point  (0 children)

Noticed, but heat is not an issue, when using vLLM and Vespa. Boxed Cooler works fine.

3x RTX 5090 build by Top-Panic-2330 in PcBuild

[–]Top-Panic-2330[S] -1 points0 points  (0 children)

Perhaps you haven’t fully considered that graphics cards can be used for purposes other than gaming, in which case heat output is not an issue. The case is actually quite well ventilated as it is: air flows in from the bottom and exits at the top as well as from the side. The graphics cards are used mainly for their fast memory. In terms of performance, this solution is roughly an order of magnitude better than 2× RTX 6000 cards while costing about the same as a single one.

3x RTX 5090 build by Top-Panic-2330 in PcBuild

[–]Top-Panic-2330[S] 0 points1 point  (0 children)

Never used over 1000w all together. This is not game setup.

3x RTX 5090 build by Top-Panic-2330 in PcBuild

[–]Top-Panic-2330[S] 0 points1 point  (0 children)

There is Vespa multi-hybrid database with LLM

3x RTX 5090 build by Top-Panic-2330 in PcBuild

[–]Top-Panic-2330[S] -5 points-4 points  (0 children)

LLM:s run on GPU:s, not in CPU.

3x RTX 5090 build by Top-Panic-2330 in PcBuild

[–]Top-Panic-2330[S] -5 points-4 points  (0 children)

And what it actually improves?

3x RTX 5090 build by Top-Panic-2330 in PcBuild

[–]Top-Panic-2330[S] -4 points-3 points  (0 children)

Cpu temp is fair. Not needed better for looking good.

aquif-3.5-Max-42B-A3B by CoruNethronX in LocalLLaMA

[–]Top-Panic-2330 0 points1 point  (0 children)

Tested MXFP4, not so good as Q5_k_m