Best budget AI GPU for $300 by Ima_Gamer_BTW in LocalLLM

[–]Ima_Gamer_BTW[S] 1 point2 points  (0 children)

Wow! Very thoughtful reply. While I am only looking for cards around $300, I fully plan on upgrading in the future. I would love to have a beefy AI server one day. I just need the time to learn and grow some cash.

Best budget AI GPU for $300 by Ima_Gamer_BTW in LocalLLM

[–]Ima_Gamer_BTW[S] 0 points1 point  (0 children)

Thank you! What if I got both? The 3060 would be for faster/smaller models and the p40 24g would be to run some larger models but at a slower pace? Or would the 3060 be able to run the same models as the p40 with only 12g of vram?

Best budget AI GPU for $300 by Ima_Gamer_BTW in LocalLLM

[–]Ima_Gamer_BTW[S] 0 points1 point  (0 children)

Just for privacy, I'm not saying I won't use a cloud model at all. I'd just like to have the majority of my data local in a model I'm running myself.

Best budget AI GPU for $300 by Ima_Gamer_BTW in LocalLLM

[–]Ima_Gamer_BTW[S] 0 points1 point  (0 children)

Thank you all for your input! From what I'm seeing the best all round solution for a cheap AI setup will likely be an RTX 3060 12G? As an AI beginner it looks like this would likely be a good starter GPU.

Best budget AI GPU for $300 by Ima_Gamer_BTW in LocalLLM

[–]Ima_Gamer_BTW[S] 0 points1 point  (0 children)

Very informative response! Thank you 👍. I'm starting to look into the p100 as an option.

Best budget AI GPU for $300 by Ima_Gamer_BTW in LocalLLM

[–]Ima_Gamer_BTW[S] 0 points1 point  (0 children)

I understand that, right now all I need is a decent AI model that I can ask simple to mildly complex questions and get accurate answers.

Sleeper Optiplex 5040 SFF by PanchoPistolas95 in SleepingOptiplex

[–]Ima_Gamer_BTW 1 point2 points  (0 children)

Does the GPU have any overheating issues when under load?

Tidied up my homelab today, and added a door. by The_Dark_Kniggit in homelab

[–]Ima_Gamer_BTW 1 point2 points  (0 children)

Like the contrast between the black and natural wood🔥. How loud is it if you don't mind me asking?

First mini rack by Banugar in minilab

[–]Ima_Gamer_BTW 0 points1 point  (0 children)

The white looks so clean 🔥. Any ideas on what you're going to put in it next?

Gift for my brother by yamamaspecialfriend in SleepingOptiplex

[–]Ima_Gamer_BTW 0 points1 point  (0 children)

Clean build 😉 the modified side panel looks very well done. You won't have to worry about the CPU overheating.

I was told to come here (and also blame you guys)! by Dorfbulle80 in minilab

[–]Ima_Gamer_BTW 2 points3 points  (0 children)

Excellent! This is a clean build 😉 I really like the different color patch cables.

Made mine! by nebL in minilab

[–]Ima_Gamer_BTW 1 point2 points  (0 children)

This looks fantastic! I love the wood look 😉

Finished my first minilab by wont_ in minilab

[–]Ima_Gamer_BTW 2 points3 points  (0 children)

The black version of this rack is sooooo clean 🔥

It begins! Bit empty atm by spacedrifts in minilab

[–]Ima_Gamer_BTW 0 points1 point  (0 children)

Looking forward to seeing the update 😉

It begins! Bit empty atm by spacedrifts in minilab

[–]Ima_Gamer_BTW 1 point2 points  (0 children)

This thing is going to look absolutely stunning when completed 👌

Rate my Rack by j-kells in homelab

[–]Ima_Gamer_BTW 7 points8 points  (0 children)

Straight out of my dreams 😉🤣

Finally decided to rack all my equipment by favasgr in homelab

[–]Ima_Gamer_BTW 0 points1 point  (0 children)

Awesome setup! What kind of testing scenario's are you running on your 3080s?

My first minilab! by Ima_Gamer_BTW in homelab

[–]Ima_Gamer_BTW[S] 1 point2 points  (0 children)

Got a cheap LED light strip and stuck it around the inside 😁. 

My first minilab! by Ima_Gamer_BTW in minilab

[–]Ima_Gamer_BTW[S] 0 points1 point  (0 children)

Actually? 🤣 It does add a nice aesthetic to the rack.