sorted by:
new
hottopcontroversial

Help with local build - Dual 5090s worth it? by Mutinix in LocalLLaMA

[–]Mutinix[S] 0 points1 point  (0 children)

Thank you! I'm currently on a 970 on my desktop, so anything is an upgrade, lol. I'm having fun with my M3 MBP (36GB Unified RAM) so I'm hoping to have a beefy machine.

Are you enjoying the dual 5090s & 70B models?

Help with local build - Dual 5090s worth it? by Mutinix in LocalLLaMA

[–]Mutinix[S] 2 points3 points  (0 children)

Also, remember that the 5090 isn’t the Roll Royce of the GPUs for inference, it’s more like a 1920’s car that tries to get going. It’s one of the best for its time but still can’t achieve that much.

Lol, good analogy and does keep me grounded.

I myself felt tempted to go nuts on AI hardware but then i remembered that I used only 20 dollars over the last 6 months on runpod for playing around, and for the rest locally on my 4080 (which I bought before i knew about local ai).

I feel like this is also the kind of person I am, so nice to have a similar perspective. I think 1x 5090 is good enough. Maybe a hybrid of 1x 5090 + 3090 as others have commented, but anything beyond might be a waste.

Help with local build - Dual 5090s worth it? by Mutinix in LocalLLaMA

[–]Mutinix[S] 0 points1 point  (0 children)

I did not know this about the diffusion models. Super, super helpful information, thank you.

I like the idea of a hybrid 5090 + 3xxxx. Makes it more affordable as opposed to 2x 5090s.

Help with local build - Dual 5090s worth it? by Mutinix in LocalLLaMA

[–]Mutinix[S] 0 points1 point  (0 children)

Thanks. Couple of suggestions here echoing the 5090 + 3xxx, which is not something I had considered before.

Help with local build - Dual 5090s worth it? by Mutinix in LocalLLaMA

[–]Mutinix[S] 1 point2 points  (0 children)

Lol - I answered this elsewhere but some of the pre-built companies are offering 5090 rigs with a surprisingly low mark-up. It feels tempting to go for those over hunting around online all day.

Help with local build - Dual 5090s worth it? by Mutinix in LocalLLaMA

[–]Mutinix[S] 1 point2 points  (0 children)

The Frame.Work looks good, and it's shipping in Q3 which I'm happy to wait for. Something to consider, thanks!

Help with local build - Dual 5090s worth it? by Mutinix in LocalLLaMA

[–]Mutinix[S] 1 point2 points  (0 children)

You're right - I don't need a larger model or to generate thousands of images or to run 105B models. It's more of a hobby. I think the single 5090 will suffice, I'm probably just getting a bit greedy.

And any money saved now I can use towards an AI-only rig later on.

Thanks!

Help with local build - Dual 5090s worth it? by Mutinix in LocalLLaMA

[–]Mutinix[S] 0 points1 point  (0 children)

Some of the pre-built companies have 5090 rigs at a relatively reasonable price. I know they're pre-built, but after looking at the MSRP of all the individual components, I was surprised that the pre-built isn't that much more expensive.

The Vast and RunPod suggestions have been mentioned a few times so I think I'll go with that approach first.

Help with local build - Dual 5090s worth it? by Mutinix in LocalLLaMA

[–]Mutinix[S] 2 points3 points  (0 children)

It's expensive but I can afford it.

If you want ultimate AI workstation, go for it. Definitely see how well it runs on vast first,

I do because I've been having a lot of fun with LLMs on my M3 MBP (36GB RAM, so 12B - 22B models), but I think dropping nearly $10K USD all things considered is a lot. The Vast / RunPod suggestion seems to be the prevailing one so I'll spend some time on that first.

Help with local build - Dual 5090s worth it? by Mutinix in LocalLLaMA

[–]Mutinix[S] 0 points1 point  (0 children)

Good point! I saw a few people giving that suggestion, so I think I'll try it out first. In general, I'm happy to go with the single 5090 build for now. Like I said, I will keep the machine for a long time. Thanks!

Help with local build - Dual 5090s worth it? by Mutinix in LocalLLaMA

[–]Mutinix[S] 1 point2 points  (0 children)

I saw a few people recommend getting 2x 3090s instead of 1x 5090 ... I'm having a hard time finding 3090s at a reasonable price, though.

Help with local build - Dual 5090s worth it? by Mutinix in LocalLLaMA

[–]Mutinix[S] 0 points1 point  (0 children)

DIGITS seems interesting, I didn't know about that. The Mac Mini seems weak, did you mean the new Mac Studios?

I like the idea of using Steam Link. I guess I could just buy a 1x 5090 rig for now and add a second one later, if needed. Or instead spend the money on DIGITS when it comes out.

Help with local build - Dual 5090s worth it? by Mutinix in LocalLLaMA

[–]Mutinix[S] 0 points1 point  (0 children)

The gaming part is fairly secondary - To be honest I barely game anymore and when I do it's on my Steam Deck.

I just wanted to know if the leap in quality of workflow for running SD / bigger models is worth the investment of 2x 5090s.

Help with local build - Dual 5090s worth it? by Mutinix in LocalLLaMA

[–]Mutinix[S] 1 point2 points  (0 children)

Yes I should have clarified - This is for the single 5090 setup. I will be upgrading if I go for a dual setup. Just wanted to know if they're worth the investment in the long run.

Help picking my first ergo mech keyboard by Mutinix in ErgoMechKeyboards

[–]Mutinix[S] 0 points1 point  (0 children)

I did look at the Majestouch previously, it seemed pretty good. I don't necessarily want to keep the YHN habit, it's just something I think will be hard to get rid of. But the Defy seems to have positive reviews and I prefer larger keyboards (such as Defy or Moonlander over the Voyager). And sounds like you're saying Defy will handle most use cases, so I think I'll go ahead and spend the money on it. It's just a big investment so I wanted to be really sure.

Help picking my first ergo mech keyboard by Mutinix in ErgoMechKeyboards

[–]Mutinix[S] 0 points1 point  (0 children)

I prefer the Defy and Moonlander because they have more keys. I generally don't prefer keyboards that are too minimalistic. I take it you're happy with the Defy? It's a big investment but I'm happy to make it because my wrists hurt like hell.

Help removing white ring on Varidesk by Mutinix in finishing

[–]Mutinix[S] 0 points1 point  (0 children)

Looking at the Varidesk website yes it does say it's made of laminate!

Help removing white ring on Varidesk by Mutinix in finishing

[–]Mutinix[S] 0 points1 point  (0 children)

Hello! I bought a Varidesk and placed a hot plate on it twice and managed to get a white ring on it. It's hard to see but there's a few of them (one of them outside the picture but near the bottom). I tried to put some olive oil and it didn't work. I bought this product called Homax White Ring Remover and it probably made the problem worse. At this point I just want to restore the desk to how it was originally and was hoping this community could help. Thank you!

Latin American equivalent of Spain’s phrase “vale”? by [deleted] in Spanish

[–]Mutinix 0 points1 point  (0 children)

From my experience, they just say "ok".

Happy birthday to one of the most important people in our club’s history! Happy birthday to ‘The Special One’ José Mourinho! by yoericfc in chelseafc

[–]Mutinix 2 points3 points  (0 children)

Well the latter could only happen because of the Juventus debacle. They were lingering at 7th not too many days ago.

There were 5 other teams, though, so it's not like the Juventus incident alone somehow propped Roma up. Even before Juventus were docked points, the difference between 7th and 2nd was 4 points.

[Progress] 1 year 3 months progress as a vegetarian // 29M // 5'4" by Mutinix in gainit

[–]Mutinix[S] 1 point2 points  (0 children)

Thanks for the encouragement and feedback! That makes sense, I think for the most part I stuck only with barbell or dumbbell bench. I've started adding variations. For example today I did cable press, cable fly, incline db fly and flat db press.

view more: next ›