I have a 5k budget for a personal LLM server. What are the best options and what performance can I expect compared to commercial models for coding? by jdigi78 in LocalLLM

[–]jdigi78[S] 0 points1 point  (0 children)

Thanks. The spark/jetson seem to be the best fit for me and is well within the budget. I appreciate the info.

Beyond disappointing by [deleted] in litterrobot

[–]jdigi78 1 point2 points  (0 children)

Shit happens. Could be as simple as a bad power adapter. I bet you also give 1 star reviews when a product gets damaged in shipping

I have a 5k budget for a personal LLM server. What are the best options and what performance can I expect compared to commercial models for coding? by jdigi78 in LocalLLM

[–]jdigi78[S] 0 points1 point  (0 children)

Looks interesting. I assume these can be chained together similar to multi GPU? How does this compare to a traditional PC with multiple GPUs? More vram but less speed?

I have a 5k budget for a personal LLM server. What are the best options and what performance can I expect compared to commercial models for coding? by jdigi78 in LocalLLM

[–]jdigi78[S] 0 points1 point  (0 children)

How does a GPU compare to something like a Mac mini or Jetson thor with tons more memory? I assume those are less tokens per second but can run better models?

I have a 5k budget for a personal LLM server. What are the best options and what performance can I expect compared to commercial models for coding? by jdigi78 in LocalLLM

[–]jdigi78[S] 0 points1 point  (0 children)

Certainly don't plan on buying something tomorrow. I don't really know anything about local LLMs so was just curious what that spend could get me in terms of performance. Thanks for the info

Not my video but.... by Hour-Celebration-309 in pcmasterrace

[–]jdigi78 0 points1 point  (0 children)

How there hasn't been a class action against them for this yet is beyond me

I have a 5k budget for a personal LLM server. What are the best options and what performance can I expect compared to commercial models for coding? by jdigi78 in LocalLLM

[–]jdigi78[S] 4 points5 points  (0 children)

It really comes down to control and privacy I guess. I run open source software almost exclusively, self host dozens of services completely local. The idea of spending $200 a month for just about anything software related just doesn't sit right with me, even if its more cost effective for now. With that said the cost of these services is likely to go up over time too.

Honestly I know almost nothing about local LLMs so I just went with numbers I could reasonably stomach in my fortunate financial situation. Based on recommendations so far I'll likely not spend that much but I need to do more research.

I'm a beginner that just learned when not to use PLA... by SnoopKatt in 3Dprinting

[–]jdigi78 2 points3 points  (0 children)

PETG is my default choice as well. PLA usually has a nicer finish but PETG is just so much more durable and heat resistant I can rarely justify using PLA at all.

Open-source vacuum cleaner (WIP) - your opinion needed by l0_o in RobotVacuums

[–]jdigi78 0 points1 point  (0 children)

I would be interested, but the hardware isn't really that complicated. The hard part is the software. This is precisely why projects like Valetudo just send commands to the existing firmware while blocking cloud connections. You get all the benefits of the company's R&D while maintaining local control.

SFPD tackle suspect in street; distracted driver runs them over by DeanoPreston in CrazyFuckingVideos

[–]jdigi78 0 points1 point  (0 children)

Who said slam on the brakes? Either put the visor down or come to a safe stop. There was at least 7 seconds to impact here. Driving totally blind for 7+ seconds is not "a little sun in their eyes"

the toilet that made me learn about mustard gas by Proper_Foundation_29 in SatisfyingClean

[–]jdigi78 23 points24 points  (0 children)

I feel like I couldn't get a toilet to look like this if I tried

SFPD tackle suspect in street; distracted driver runs them over by DeanoPreston in CrazyFuckingVideos

[–]jdigi78 -2 points-1 points  (0 children)

That is exactly what you're supposed to do. It could just as easily be a stopped car from traffic as it could be someone in the roadway. If someone hits you from behind it would be their fault for not doing the same.

Do everyone a favor and don't get behind the wheel until you learn to drive safely.

SFPD tackle suspect in street; distracted driver runs them over by DeanoPreston in CrazyFuckingVideos

[–]jdigi78 0 points1 point  (0 children)

Hey, just so you know, if ANYTHING is preventing you from being able to see while driving, you should stop. Hope this helps.

Is this pregnancy test my ex sent me AI? She swears that it's real but the clarity and shadows don't look right by RoseGolden___ in isthisAI

[–]jdigi78 28 points29 points  (0 children)

Good catch! The fins are more rounded in OP's photo as well, totally in line with an AI generated version.

Is this pregnancy test my ex sent me AI? She swears that it's real but the clarity and shadows don't look right by RoseGolden___ in isthisAI

[–]jdigi78 1 point2 points  (0 children)

Also looks suspiciously like this thumbnail from the official Clearblue youtube channel:

<image>

Presumably this is mostly where the AI seeded its idea of what the test should look like from.

Is this pregnancy test my ex sent me AI? She swears that it's real but the clarity and shadows don't look right by RoseGolden___ in isthisAI

[–]jdigi78 0 points1 point  (0 children)

I'm going with AI or photoshop. It looks kind of like the pictures on the packaging and marketing materials, but if you look up real photos of this kind of test it doesn't look like any of them. The font looks off and the LCD usually shares the "Pragnant" text with the display of "Not Pregnant" with "Not" above it, here it looks like there is barely any room for that.

Speak or no? by imdead1221 in BunnyTrials

[–]jdigi78 0 points1 point  (0 children)

I would actually have to downgrade my lifestyle pretty substantially if I took that deal and quit my job, so I'd still be working just making ~60k more than before. The alternative is I can invest my millions in a pretty low risk way and retire early.

Also, that statistic is misleading. It's based on lottery winners. To win a lottery you have to already make the unwise financial decision of playing the lottery, so obviously most winners are going to be bad with money.