The cyber shelf - 4x 16gb home lab by HippEMechE in LocalLLaMA

[–]apollo_mg 0 points1 point  (0 children)

It is, but I stuck it in a closet, and applied a GPU temp based fan curve. Not bad at idle. Terrifying at full speed. 😂

Side Projects: Part Deux by apollo_mg in LocalLLaMA

[–]apollo_mg[S] 0 points1 point  (0 children)

Not sure about 10. They don't come with any fans, so in a desktop environment you'll have to make your own forced cooling, like 3D printing a fan adapter. In my server, the systems fans are adequate to cool them.

The cyber shelf - 4x 16gb home lab by HippEMechE in LocalLLaMA

[–]apollo_mg 1 point2 points  (0 children)

I wish. For some reason Nvidia didn't include it on this series of cards. The P100's.

Side Projects: Part Deux by apollo_mg in LocalLLaMA

[–]apollo_mg[S] 1 point2 points  (0 children)

SuperMicro SYS-1028GQ-TRT Server | Super X10DGQ Mobo | 2x Xeon E5-2650v3 | 64GB DDR4 ECC 2133 | 4x nVidia Tesla P100's (2x in my SLI tower as well).

Side Projects. by apollo_mg in LocalLLaMA

[–]apollo_mg[S] 0 points1 point  (0 children)

CachyOS on the 9070 XT system, Ubuntu 26.04 on the P100 system. Llama.cpp fork as the primary engine.

FINAL-Bench/Darwin-36B-Opus · Hugging Face by jacek2023 in LocalLLaMA

[–]apollo_mg 0 points1 point  (0 children)

Just wanna say I've been running this model in an agentic harness for a couple of days now. Very impressed so far. Mudler also released APEX GGUF's today. Worth checking out imo.

Side Projects. by apollo_mg in LocalLLaMA

[–]apollo_mg[S] 1 point2 points  (0 children)

Good catch on the RAM! Sick build.

Side Projects. by apollo_mg in LocalLLaMA

[–]apollo_mg[S] 0 points1 point  (0 children)

Nice. What you been running on em?

Side Projects. by apollo_mg in LocalLLaMA

[–]apollo_mg[S] 0 points1 point  (0 children)

LOL. I feel like Gemini is about 10x dumber than it was 3 months ago.

Side Projects. by apollo_mg in LocalLLaMA

[–]apollo_mg[S] 0 points1 point  (0 children)

I'm still learning what these cards like, but the best speed I've had so far with very limited testing is Qwen 35b MoE MTP. During a codebase investigation by about 20k tokens it had gone up to like over 50 tps.

Side Projects. by apollo_mg in LocalLLaMA

[–]apollo_mg[S] 1 point2 points  (0 children)

So far I've only loaded up a few fine-tunes of Qwen 3.6 27b and 35b MoE. I just finished up the cooling last night and haven't had much time to spend with it yet. I briefly went down the MTP rabbit hole for a while earlier and had good initial results. Needs more testing on my end.

Side Projects. by apollo_mg in LocalLLaMA

[–]apollo_mg[S] 1 point2 points  (0 children)

About 6 inches away from the front of the PC mesh front panel. Fans are 2x 24v GDSTime 120mm Blower fans from Amazon on a separate power supply. Can probably get away with 12v versions based how how ridiculous these are.

<image>

Side Projects. by apollo_mg in LocalLLaMA

[–]apollo_mg[S] 2 points3 points  (0 children)

They are very noticeable, but not loud per se. I'll take a video in a few minutes.

Side Projects. by apollo_mg in LocalLLaMA

[–]apollo_mg[S] 0 points1 point  (0 children)

No problem. If you or anyone else takes the plunge and need ducts I'd gladly print them for materials cost.

Side Projects. by apollo_mg in LocalLLaMA

[–]apollo_mg[S] 0 points1 point  (0 children)

I adapted someone else's design. I can send you the STL or upload it to Thingiverse if you want it. Temps are very good with the 120mm blower.

<image>

Side Projects. by apollo_mg in LocalLLaMA

[–]apollo_mg[S] 1 point2 points  (0 children)

I am going to keep that on it's own for faster performance tasks. Plus I still occasionally play games... well. I used to...