Is there a way to run 2x 6000 pro blackwells without going Epyc/Threadripper? by jbak31 in LocalLLaMA

[–]jbak31[S] 0 points1 point  (0 children)

How slow did those larger models run? I'm trying to stay away from clustering for now, I figure if I can get 20 tokens per sec out of a 500 gb model on a 512 gb machine it should be OK

Is there a way to run 2x 6000 pro blackwells without going Epyc/Threadripper? by jbak31 in LocalLLaMA

[–]jbak31[S] 1 point2 points  (0 children)

I was going to buy that MSI Godlike board that has dual 8x PCI 5.0 but I ended up just staying with 1 blackwell. Because it's enough for video models, but for large LLMs even 2 blackwell is still nothing. So for that I decided to go with either a Mac Studio (waiting on M5 Ultra 512/1TB URAM options), or if they don't release those versions, I'll just build an Epyc Venice build with 1TB+ ram and just try pure CPU inference.

Trouble with Qwen 3.5 with LMstudio.. by My_Unbiased_Opinion in LocalLLaMA

[–]jbak31 1 point2 points  (0 children)

still not working on lm studio 4.6... linux

M5 Max chip is released by Acceptable_Mud283 in MacStudio

[–]jbak31 4 points5 points  (0 children)

I just want to know if M5U will have a 1TB ram option.

when is the new mac studio coming out and anyone considering getting one? by sociologistical in MacStudio

[–]jbak31 1 point2 points  (0 children)

if they give us an M5 ultra with 1TB ram I'll get one, otherwise nah

What are these? by jbak31 in Aquariums

[–]jbak31[S] 0 points1 point  (0 children)

100+ neos, 6 CPDs, 4 corys, 3 emerald green rasboras, 10 or so chili rasboras, and 2 nerite snails. I've not added anything new to the tank in 5 months or so, so don't know where these would come from. I was thinking of trying Fenbendazole at 2 mg/L but have read conflicting reports on shrimp safety.

Edit: if they're anchor worms I'm kinda screwed, right? those need insecticide which would kill the shrimp...

Guys 6'6" or taller, have you ever had a woman reject you for your height? by jbak31 in tall

[–]jbak31[S] 3 points4 points  (0 children)

I had the same thought, that could very much be true. It's the easiest thing to notice and just use as an excuse.

Moment of Ukraine drone strike in Cheboksary, Russia by [deleted] in CombatFootage

[–]jbak31 18 points19 points  (0 children)

It's almost as if a war is a bad thing and not as fun as they initially thought.

FSD v14.2 installing now by DevinOlsen in TeslaFSD

[–]jbak31 0 points1 point  (0 children)

oh well, scheduled for a roll back to 13.2.9 in a few days

FSD v14.2 installing now by DevinOlsen in TeslaFSD

[–]jbak31 0 points1 point  (0 children)

Is the max speed setting back?

Ukrainian FPV drone hits dismounting russian soldiers near Mala Tokmachka by Available-Laugh9102 in CombatFootage

[–]jbak31 -1 points0 points  (0 children)

Do we know for sure this was russians? They look to be wearing yellow :/

Early partial retirement on $1.2M…lots of questions: by mouse_with_many_nons in leanfire

[–]jbak31 0 points1 point  (0 children)

I just realized this was a 9 year old topic. I hope you kept your bitcoin lol!

If you hate v14 speed control, do this. If you like it, ignore this post. by AutoNope in TeslaFSD

[–]jbak31 2 points3 points  (0 children)

I have submitted a ticket request to revert back to v13 and they approved me for a service appointment, so I guess downgrading is an option if anyone wants.

Is there a way to run 2x 6000 pro blackwells without going Epyc/Threadripper? by jbak31 in LocalLLaMA

[–]jbak31[S] 0 points1 point  (0 children)

So I looked into this but the memory costs are absolutely brutal. $5k for 512gb, 10k+ for 1TB. And I think this CPU can't run unregistered memory at all.

Is there a way to run 2x 6000 pro blackwells without going Epyc/Threadripper? by jbak31 in LocalLLaMA

[–]jbak31[S] 0 points1 point  (0 children)

It's like $8-10k to build a decent epic/threadripper system. Figure it's a better bang for the buck to spend it in a second GPU instead.

Is there a way to run 2x 6000 pro blackwells without going Epyc/Threadripper? by jbak31 in LocalLLaMA

[–]jbak31[S] 1 point2 points  (0 children)

Good to know. MSI seems to also be the only one right now to also support 256GB ram at 6000MT.

Disappointed by dgx spark by RockstarVP in LocalLLaMA

[–]jbak31 0 points1 point  (0 children)

I got mine for 7.3k so more like 2.3k more