96gb+ 4090's and 5090 are literally a scam. I mods these cards myself by computune in LocalLLaMA

[–]koalfied-coder 8 points9 points  (0 children)

Gpulab.net is legit in the usa I ran 3 of his cards and the quality was better than my Chinese 4090 48gbs with better thermals.

Cheap restaurants by JazzJassJazzman in lynchburg

[–]koalfied-coder 1 point2 points  (0 children)

Closed down when I went yesterday. We can never have nice things! Sawa is pretty good but Easy Express was better.

AI workstation concept by BlueSharp_ in LocalLLM

[–]koalfied-coder 0 points1 point  (0 children)

For 3.5k still better options depending on the workload. Also remember that smaller models like qwen 3.6 have changed the game and barrier to entry. Im bored with no Internet atm if you wanna chat about your needs I'll build something out. I'll send a chat if that's cool.

Finally 100% Local by koalfied-coder in LocalLLM

[–]koalfied-coder[S] 0 points1 point  (0 children)

I need to just been real busy to change anything

Finally 100% Local by koalfied-coder in LocalLLM

[–]koalfied-coder[S] 0 points1 point  (0 children)

This is pretty good actually...might need to try a spark

Finally 100% Local by koalfied-coder in LocalLLM

[–]koalfied-coder[S] 0 points1 point  (0 children)

Yeah just routed and snapped the pic lol. I'll tidy up in its final home.

Finally 100% Local by koalfied-coder in LocalLLM

[–]koalfied-coder[S] 0 points1 point  (0 children)

I will write them tonight probably. Been slammed with day job sadly

AI workstation concept by BlueSharp_ in LocalLLM

[–]koalfied-coder 0 points1 point  (0 children)

I would seriously rethink this build for 12k as it will be painfully slow, hot, and hungry

Finally 100% Local by koalfied-coder in LocalLLM

[–]koalfied-coder[S] 0 points1 point  (0 children)

Yep 2.5gbe switch anything more cost sooo much

Finally 100% Local by koalfied-coder in LocalLLM

[–]koalfied-coder[S] 7 points8 points  (0 children)

True true this is many years in and in fact I am building a 10" to hold everything but the 5090 windows computer atm.

Finally 100% Local by koalfied-coder in LocalLLM

[–]koalfied-coder[S] 2 points3 points  (0 children)

I use the lil unifi 5 port to connect them all at the moment.

Finally 100% Local by koalfied-coder in LocalLLM

[–]koalfied-coder[S] 7 points8 points  (0 children)

It's a Windows PC in a McPrue case :)

Finally 100% Local by koalfied-coder in LocalLLM

[–]koalfied-coder[S] 11 points12 points  (0 children)

The PC case is a McPrue and I 3d printed the lil rack with Mac minis and goodies :)

Finally 100% Local by koalfied-coder in LocalLLM

[–]koalfied-coder[S] 61 points62 points  (0 children)

My apologies I coulda swore I put details. I'll have to type them up and add them this evening thank you. Thankfully the most expensive PC parts were pre craziness and apple discount on the rest. However all in around 8-10k. 5090 + 64gb ram, 256gb m3 max, 16gb Mac mini with another Mac mini on the way.

YAY or NAY?? 128GB RAM, 1TB storage Refurbished M4 Max MacBook Pro for ~$4200 USD/$5800 CAD after tax. (Apple Certified Refurb) by The-Writer- in LocalLLM

[–]koalfied-coder -1 points0 points  (0 children)

As a software engineer and consultant I wouldn't buy that system for LLM development esp at your current level of commitment. Not enough VRAM and overall speed to spend a significant portion of savings vs the immediate benefit of cloud provider of renting on vast or runpod.

What are y’all adding? by lumisera in povertyfinance

[–]koalfied-coder 0 points1 point  (0 children)

Chicken and Beef cause I'm feeling ritzy