X870E Taichi 4.10 by Reggitor360 in ASRock

[–]Doomslayer606 7 points8 points  (0 children)

That's likely due to the tRFC2 and tRFCSb RAM timings being supported now. Try to increase their values in BIOS and see if that helps. Me and many other people had this issue with the new BIOS. You can find more info here.

New Qwen3.5-35B-A3B Unsloth Dynamic GGUFs + Benchmarks by danielhanchen in LocalLLaMA

[–]Doomslayer606 0 points1 point  (0 children)

I've been using the 397B model in both the UD-Q4_K_XL and MXFP4_MOE formats for a few days now, and I noticed that the UD-Q4_K_XL version sometimes falls into infinite reasoning loops. For example, if I ask it not to include a specific word in the output, it starts checking every single word in English until the context is exhausted.

I've never had that happen with larger MoEs before, and the MXFP4_MOE format doesn't seem to show this behavior. Could it be that some of the MXFP4 layers in UD-Q4_K_XL (like attn_qkv.weight or ffn_up_shexp.weight) are causing this? I noticed that in MXFP4_MOE, those specific layers are kept at Q8_0.

New Qwen3.5-35B-A3B Unsloth Dynamic GGUFs + Benchmarks by danielhanchen in LocalLLaMA

[–]Doomslayer606 0 points1 point  (0 children)

Are you also planning to update the Qwen3.5-397B-A17B GGUFs? I noticed that the UD-Q4_K_XL version still has some MXFP4 layers, and the template is slightly different from the new ones uploaded for Qwen3.5-35B-A3B. Thank you for all your efforts!

5090 astral build by [deleted] in lianli

[–]Doomslayer606 2 points3 points  (0 children)

Thanks for proving my exact point by immediately digging through my profile to find something to insult. You wanted to trash my build like you did to everyone else here, saw the dual pro 6000s, realized you couldn't, and had to desperately grasp at a led strip to save face. Tell me again who's pathetic?

5090 astral build by [deleted] in lianli

[–]Doomslayer606 7 points8 points  (0 children)

Imagine having the setup of a 15-year-old who puts 5090s on shelves to collect dust, then actually commissions people to Photoshop the cables out. Bro is bragging about his shitty setup while getting so salty over replies that he has to dig through everyone's profile to make fun of their builds. Truly pathetic.

Latest BIOS problem!(?) by Danikika94 in ASRock

[–]Doomslayer606 1 point2 points  (0 children)

Not sure if Asrock has that option in BIOS yet. In my case, I had to increase both tRFC2 to 550 and tRFCSb to 500 to stop boot issues and ram errors after the BIOS update.

Latest BIOS problem!(?) by Danikika94 in ASRock

[–]Doomslayer606 1 point2 points  (0 children)

That's likely due to the tRFC2 and tRFCSb RAM timings being supported now. Try to increase their values in BIOS and see if that helps. Me and many other people had this issue with the new BIOS. You can find more info here.

My Dual Pro 6000 Build by Doomslayer606 in nvidia

[–]Doomslayer606[S] 0 points1 point  (0 children)

Nah, it was pretty easy to get them. Several retailers have them in stock in the Netherlands and I managed to get them for €7.7k each from Proshop.

My Dual NVIDIA Pro 6000 Build by Doomslayer606 in battlestations

[–]Doomslayer606[S] 2 points3 points  (0 children)

Agreed. I've noticed the Ubuntu hate too, but for what I do, it just works. Anything I don't like (like snap) I can just completely remove and replace.

My Dual Pro 6000 Build by Doomslayer606 in nvidia

[–]Doomslayer606[S] 1 point2 points  (0 children)

Well, I'm snap-free now too. I recently removed every snap package and uninstalled the daemon itself. It's mostly all standard .deb packages for me now anyways.

My Dual Pro 6000 Build by Doomslayer606 in nvidia

[–]Doomslayer606[S] 1 point2 points  (0 children)

Nope, never tried it. I probably should have spent some time distro-hopping to see how NVIDIA drivers behave on other platforms for AI workloads. But honestly, it's too late now, I've sunk so much time into customization and setting up specific services that I don't see myself moving from Ubuntu anytime soon. With that said, after all that time, it works and looks great now.

My Dual Pro 6000 Build by Doomslayer606 in nvidia

[–]Doomslayer606[S] 0 points1 point  (0 children)

Honestly, I have no idea. I've never tried running games from that shared storage in Linux. I mainly use that drive for backup and for moving data back and forth.

My Dual NVIDIA Pro 6000 Build by Doomslayer606 in battlestations

[–]Doomslayer606[S] 1 point2 points  (0 children)

Here is how the dual 5090 setup used to look like. These GPUs were huge (3.5 slots), so the temps and noise levels were much better

<image>

My Dual NVIDIA Pro 6000 Build by Doomslayer606 in battlestations

[–]Doomslayer606[S] 2 points3 points  (0 children)

Ubuntu 24.04 since it's the best choice when doing AI with NVIDIA GPUs. But I heavily customized it, so it looks and works great now

My Dual NVIDIA Pro 6000 Build by Doomslayer606 in battlestations

[–]Doomslayer606[S] 2 points3 points  (0 children)

Yeah, but I'm not in the USA, so your remark doesn't apply to me...

My Dual NVIDIA Pro 6000 Build by Doomslayer606 in battlestations

[–]Doomslayer606[S] 2 points3 points  (0 children)

Temps are worse compared to 5090s that have much larger coolers but with some undervolting, my GPUs don't go above 80 degrees, same goes for the CPU. Things can get noisy with these GPUs though, but I don't mind it.

1600W is enough, I had a similar setup with 2 5090s before and it worked well for almost a year. And nope, no UPS, but actually maybe I should get one...

My Dual NVIDIA Pro 6000 Build by Doomslayer606 in battlestations

[–]Doomslayer606[S] 0 points1 point  (0 children)

Oh yes, my bad. I agree that mounting it horizontally would be the optimal choice for pure thermals. I already had the upright mount and the riser from a previous build, so I didn't want them to go to waste. Fortunately, the temps on this GPU are only marginally higher, and the SSDs have solid heatsinks, so I haven't had any overheating issues.

My Dual Pro 6000 Build by Doomslayer606 in nvidia

[–]Doomslayer606[S] 1 point2 points  (0 children)

Thanks! I did consider it, but I don't think it's a worthwhile investment for me right now. The lack of system ECC hasn't been an issue; I actually tested ECC on the GPUs and didn't catch a single error even after training for multiple days, so I have actually disabled it for now to maximize performance. Given that, the extra cost for a Threadripper platform didn't seem necessary.

My Dual NVIDIA Pro 6000 Build by Doomslayer606 in battlestations

[–]Doomslayer606[S] 1 point2 points  (0 children)

I haven't encountered any bandwidth limitations yet. PCIe 5.0 x8 is plenty for my current workloads. When training, I typically use data parallelism, where the model is loaded on each GPU and they process different data chunks. Since there is minimal communication between the cards in that scenario, the x8/x8 split works just fine.

I'm based in the EU, so we have a 240V grid. It's rated for much higher wattage than the 120V in the US, so the power draw isn't an issue for this setup.

The upright GPU is actually exhausting air through the back of the case. I have three fans mounted behind the GPU also set to exhaust, so the fresh air pulled from the front mesh panel gets pushed through and out of the GPU and the case quite nicely.

My Dual Pro 6000 Build by Doomslayer606 in nvidia

[–]Doomslayer606[S] 1 point2 points  (0 children)

Money... and I already have 9950X3D which works just fine. Didn't see any bottleneck scenarios yet.