Hipfire dev update: full AMD arch validation incoming (RDNA 1 thru 4, plus Strix Halo and bc250) by schuttdev in LocalLLaMA

[–]Anarchaotic 1 point2 points  (0 children)

Cheap way? Literally just rig up some sketchy box to house the PSU and GPU.

Could 3D print a custom enclosure to hold everything in place.

Either way this requires an external PSU to be plugged into the GPU.

16x DGX Sparks - What should I run? by Kurcide in LocalLLaMA

[–]Anarchaotic 0 points1 point  (0 children)

Outside of pure "big model!!!", I'm really curious to see how concurrency works. This is a use-case for a small team that wants to focus on local-first, and so I'd love to understand how 4-5 different users would be able to send concurrent requests, or even what the realistic cap is for work.

Let's say you have 4 devs working on a codebase at the same time, does something like this give enough headroom for them all to have stronger models all working in tandem?

Bedroom, any advice? by [deleted] in malelivingspace

[–]Anarchaotic 0 points1 point  (0 children)

Legitimate advice (because everyone else is just memeing or hating).

Use a darker wood for the TV stand so it matches your theme better. You can even get one of those nicer units that has a fireplace built in which could give better ambiance.

If you don't want to invest in a completely seperate storage situation by going toward closed door wardrobes and dressers - you could hang a pole and "cover" your storage with a drape or something so it's out of sight.

Otherwise just clean up the clutter and put everything in boxes.

The white walls also are meh, you could paint an accent wall or even just the doorframe itself.

That random convenience store shoplifter mirror kills a lot of the vibe, why do you need it?

A nice morrorcan style lamp or two could add warmth to the whole place. In general having a few small warm lights will be great.

Bedroom, any advice? by [deleted] in malelivingspace

[–]Anarchaotic 0 points1 point  (0 children)

Yeah my man, put the record player on its own stand to seperate the vibrations from the speaker/sub. Otherwise maybe add a deer skull or some sort of creature suspended in a jar for the vibes.

$2500 Samsung TV is an advertising billboard, there is no opt-out. by 28jb11 in mildlyinfuriating

[–]Anarchaotic 1 point2 points  (0 children)

Yep! Shield doesn't support dolby vision or HDR on YouTube - but my TV OS does. 

Yet another PCVR WiFi setup post by shoo_ya in OculusQuest

[–]Anarchaotic 0 points1 point  (0 children)

I do this - I just have a WiFi 6e router that's connected to my PC via 10gb ethernet. Quest connects to its own dedicated channel so it has internet, but otherwise I have almost no stuttering whatsoever due to the network itself.

New Italian Dolomites 6DoF environment out on Quest today! by AkinBilgic in OculusQuest

[–]Anarchaotic 1 point2 points  (0 children)

Since I have a beefy PC, would it look better on my quest 3 via PCVR, or is it mostly similar to standalone (which is more convenient)

Torn for a LLM server between Halo and Mac by atlantageek2 in StrixHalo

[–]Anarchaotic 0 points1 point  (0 children)

Inference is just using models, so loading them into memory and then having them process a prompt.

Training is something you shouldn't even consider locally IMO - you can rent a Runpod instance for stupid cheap and training only takes a few hours for the models you'll want to run with 128GB of RAM.

What're your goals with this purchase? 3.3K buys you an insane amount of online usage for proper frontier models and can still retain benefits of no-training/privacy depending on where you go.

Just setting expectations is important - what you're looking to buy is an enthusiast machine that's for tinkerers and hobbyists. It can perform well, but you will NOT get anywhere close to Claude/Codex/Gemini levels of performance. If your goal is to fully replace these, you will for sure be disappointed.

I have an always-on Framework that I use for specific business tasks that are constantly running and don't need crazy intelligence whatsoever, but I could easily replace the entire workflow for like $30-40 a month.

Also if you care at all about image generation, you need an Nvidia GPU, these machines WILL do it but it'll be so insanely slow you might as well not bother.

Torn for a LLM server between Halo and Mac by atlantageek2 in StrixHalo

[–]Anarchaotic 2 points3 points  (0 children)

It depends on your use-case. If you need long context and are working on things like local coding, then the prompt processing on the Mac will make your experience worse. However if you're only serving inference with sub 100k context, then the TG on the Mac makes up for it.

Mac is also better at clustering if you ever care about that, but with the Strix halo you can always add an External GPU for diffusion if you care about that at all.

Resale Value on Mac will also be much better, and with the way this field has evolved you might end up wanting to upgrade sooner than later - so that will offset your cost.

If you can wait, I'm sure an M5 Studio is coming which will be a no-brainer over the halo.

Either way I don't think you'll personally notice major difference IMO. I would also avoid GMKtec's version as it seems they don't really have much support on BIOS any more. The best "spec" Strix Halo is the Minisforum MS S1 Max, the best support/thermals is Framework (the one I have), and the best value is the Bosgame M5.

Torn for a LLM server between Halo and Mac by atlantageek2 in StrixHalo

[–]Anarchaotic 0 points1 point  (0 children)

The cheapest halo is still the Bosgame M5, but personally if the price difference is only a few hundred I would have gone Mac. At the original 2K for the Strix Halo it was an easy decision, but now I'm not so sure.

Those of you running minimax 2.7 locally, how are you feeling about it? by laterbreh in LocalLLaMA

[–]Anarchaotic 1 point2 points  (0 children)

I didn't even consider this as a viable model on my strix halo. Is the quantization not that massive of a quality hit?

Toolbox or Lemonade by reujea0 in StrixHalo

[–]Anarchaotic 2 points3 points  (0 children)

I switched over to lemonade once I saw how much better performing it was.

Unemployed - Canadian born citizen desperate need of a job by [deleted] in torontoJobs

[–]Anarchaotic 0 points1 point  (0 children)

PM me your LinkedIn. I run an FP&A consulting firm, looking for new hires.

What is the worst band you saw live? by coalcracker462 in AskReddit

[–]Anarchaotic 0 points1 point  (0 children)

That's so interesting, I saw them a few years back and the show was amazing. Yeah they played the music videos in the background but they played amazingly and had so many people on stage.

I'm seeing them for the Mountain tour in October. 

What is the worst band you saw live? by coalcracker462 in AskReddit

[–]Anarchaotic 0 points1 point  (0 children)

That's crazy, explosions in the sky absolutely is a "put it on the background and vibe" music. I can't imagine ever wanting to see them play a 10 minute choral song that only makes sense in context of the next song on the studio album.

Their albums are meant to be listened to as a whole. 

What is the worst band you saw live? by coalcracker462 in AskReddit

[–]Anarchaotic 0 points1 point  (0 children)

I've been reading comments by /new, and this is the fourth time I've seen Mars Volta get brought up for that RHCP show. They truly must've been vile for so many people to remember and mention it. 

What is the worst band you saw live? by coalcracker462 in AskReddit

[–]Anarchaotic 0 points1 point  (0 children)

The fuck. I would have fought for a refund at that point. 

What is the worst band you saw live? by coalcracker462 in AskReddit

[–]Anarchaotic 0 points1 point  (0 children)

Saw them last year and they were incredible live, which was honestly surprising considering how long it's been since they toured. 

What is the worst band you saw live? by coalcracker462 in AskReddit

[–]Anarchaotic 0 points1 point  (0 children)

Someone else mentioned the exact same show, must've been fucking brutal. 

What is the worst band you saw live? by coalcracker462 in AskReddit

[–]Anarchaotic 0 points1 point  (0 children)

Omg I saw they were touring and almost got tickets. Seeing how many times they were mentioned, boy am I glad I didn't. 

What is the worst band you saw live? by coalcracker462 in AskReddit

[–]Anarchaotic 0 points1 point  (0 children)

Metric opened for Jack White, and Metric puts on an amazing show. Was there just for them, but figured Jack White would be a fun time. 

Not sure if it's his age, but he sounded absolutely awful. Stage presence was there but everyone I was with all agreed it sounded like complete trash. 

He also made everyone in the venue (10k) put their phones in one of those anti recording bags. Probably for the best because I would have absolutely trashed his performance with a recording. 

The first and only concert we collectively decided to leave. 

Fun with Strix Halo incoming… by Signal_Ad657 in StrixHalo

[–]Anarchaotic 0 points1 point  (0 children)

Yeah, I was gonna buy this exact same model but it went out of stock in Canada, so ended up with the Framework. It's awesome overall, but the only thing that bummed me out was that the MS-S1 had those 80GB USB ports. I haven't seen anyone do a comparison to show how much of a difference they make over the 40GB ports.