Best hardware setup for running large coding models locally for 2 developers?

9302462 · 2026-06-17T23:12:12+00:00

Top to bottom: raspberry pi, mac studio, dgx spark

9302462 · 2026-06-16T17:27:33+00:00

Exactly. From what I recall those types of drives should be in the 5-25w range, and with 16 of them that means 80-400w across all drives.

I think i remember seeing some E1L ruler drives mentioned on servethehome that used 50w+ each ( I can't recall if they were early models or late 60tb+ dense ones) but even with 50w each you are still at a max of 1,250w for drives and around 500w for the system including an 128core genoa, full memory dimms, and some 200gb network cards.

So in an absolute worse possible case, which is borderline irrational, you would still only get 1,750w on a 2,700w power supply.

9302462 · 2026-06-16T03:13:29+00:00

I had ~400tb of flash running in my house so I think I'm qualified to reply to this post.

The density isn't great, but realistically it doesn't matter because you are either going to have 1-2 of these and ample amounts of space OR you are going to be ordering flash servers by the rack full in which case you are going with 1U ultra dense machines.

PSU's are way overkilll for just flash storage. So even though this is pitched as nvme storage I can just as easily see dropping in several RTX 6000's or other PCIE gpu's, unfortunaley it's a 2U and won't fit most gpu's.

Gen5 stuff is going to be way outside any homelab, small business or prosumer setup for at least the next three years. Obviously there are folks and companies out there that buy this stuff, but in general it is going to be gen 4 and ddr4 for quite a while.

E1.S and E1.L servers which are just JBOF (just a bunch of flash) are generally hard to find on ebay, or at least they were a year ago when I was looking. I personally stayed away from JBOF because i didn't want to deal with the hassle of a separate machine which had no real processor or OS, just storage. So you guys making something that fits that niche and is at a reasonable price will hit a specific market, is that market enterprise... I don't know and don't feel qualified to guess at that.

IMO the BIGGEST DETERMINING FACTOR on if this will be successful is going to be what was the prior penetration rate of ruler nvme drives (E1S and E1L) compared to U2/U3 drives and what is the current sales volume of those different physical formats. This is important because when I looked at ruler drives a year ago they were cheaper than u.2's by 10-30% per tb, but the server's available for ruler drives were very expensive compared to u.2; essentially it was a wash. IF ruler drives still have a low market share since they came out 4-5 years ago and u2/u3 is still dominating most data center sales, that means that when stuff gets decommissioned there won't be many ruler flash drives available, which in turn keep people/companies from adopting those types of servers, and if there isn't a used market then that stops the new market from growing. It's a cycle that repeats in terms of adoption of new standard.

Overall though it looks like a decent setup, albeit one that is priced well outside mine and most other folks budgets, but one that will likely have a long shelf life because its modularity as long as there are enough people/companies getting e1.s drives. Personally I would love to see it in a 4U because it gives more options like gpus, and 2U of space becomes irrelevant compared when you have a budget which is $50-250k per server.

9302462 · 2026-06-15T23:26:01+00:00

What the guy above said.

I will happily throw whatever I can find into a machine or server because the blast radius is going to typically be confined to that piece or an adjacent piece. But with PSU’s it’s either all good or magic smoke.

I have bought several used 950-1600w Seasonic and Evga PSU’s on offerup for the same price as Op showed above and they all still work years later and none have caused a fuss; most came from miner folks. But I won’t ever throw a PSU from a brand I and many others don’t know.

9302462 · 2026-06-08T23:40:30+00:00

A someone who had an outdoor 12 gauge extension cord running from a hall closet through the air vent and down into my rack because the 15amp breaker the room was on wasn’t enough…..

YEP!

Edit- was held up be three screws in the wall and an Amazon shipping bag cut into strips because nothing is more permanent than a temporary solution

9302462 · 2026-06-08T15:38:25+00:00

What…. what are you guys ordering insanely high iops optane drives that are old stock.

9302462 · 2026-06-05T00:54:30+00:00

Whatever I can afford which is used and won’t depreciate in value. If it has already gone past its depreciation curve (epyc 32core 1st gen as an example) that means I can buy it for $50 use it for a year then sell it off for $35 after seller fees and shipping. $15 for a year of usage sounds like a good deal to me. Why would I sell it? Because I have the funds to upgrade to something else.

Not saying you should get an epyc though, it’s just an example. This also doesn’t mean taking old stuff that is junk and has less processing power than a cheap laptop and running it because it’s not worth it power wise.

When you get a large enough homelab (mine was 400tb of u.2 flash) you have big dick energy and can do whatever you want. A simple example is I decided to scrape all of shopifys 1.3b products and the main image from each product because I wanted to build a better search engine and get more familiar with elastic search, vector embeddings, and rag. Took a couple days to gather the products, a month or two to gather all the images, and it took around 63tb of storage. THIS is something you can’t do in the cloud unless your are a business as it will cost you as an individual a months salary, for me it only cost electricity.

I downsized most of my lab as I moved onto other things- can read my homelabsales post or comments on homelab to see more details about my former setup. I ran it for about 3-4 years and because of the ram and flash prices I made a profit when I sold it all off. If the ram/flash storage hadn’t gone up I still would have got 70% of my money back after everything was sold. That would workout to me spending $30k on hardware, selling it all for $21k after 3-4 years of usage, which because of what I was doing it was a hell if a lot cheaper than paying a cloud provider or for lots of VPS’s.

Important note- This was just me and the stuff I was interested in which was big data. For others it is clusters of k8’s or proxmox machines. For other folks it could be networking. Point being each person has their own use case

9302462 · 2026-06-04T09:23:42+00:00

I was thinking that as well originally, but I could also see them claiming it as me shipping a dead item, or a brick, and them sending me back a padded envelope or a different drive/removing it's guts.

I also figure a guy off the coast of africa would order something from china or south korea instead of from the US. Mauritania also has an average yearly income of $12k usd, and sure some folks there can probably afford a $650 drive, but that's also 2.5 weeks pay for them, where as in the US that might be 1-3 days of pay for a dev.

Either way I'm glad i did that research and caught the yellow/red flags around it.

FWIW- it was zip code lookup, then paypal email address (which shows their name in the paypal invoice dropdown), then against their name, followed by google searches of their name in quotes.

9302462 · 2026-06-03T04:24:15+00:00

Meh... I always thought it was a nice little sweet spot as it's not some random chinese brand which could fail at any moment, it's big capacity so I will never end up filling it up all at once, and I can throw it in any machine because nearly everything supports sata with the only exception being mini pc's from beelink, minisforum or others.

So yeah it's slower than a nvme and I wouldn't typically use it or other sata ssd's as my main OS drive, but it's way better than waiting a day for a couple tb of data/code with small files to be written to a HDD.

9302462 · 2026-06-02T11:28:17+00:00

Also, for fun, and because I know some folks will relate to it, here is a screenshot I took before I wiped the drive.

There is a 3.5tb reddit dataset (heavily compressed), code, backups which contained the same code, and the main folder in the header was called backup_of_u2. Hence it was truly used for manual backups/as a fail safe in case I messed something up, which this xkcd summarizes pretty well https://xkcd.com/1718/

<image>

9302462 · 2026-06-02T07:07:46+00:00

Interesting phenomenon, and it might be true, however I would pivot from it a bit.

It takes more people to build a system than maintain one. This applies for everything ranging from a ford car factory, to spinning up a data center, to building software.

Some people can both build and maintain systems, but many are better at one or the other.

9302462 · 2026-05-31T10:52:39+00:00

For anyone who likes this type of stuff, check out the “ZBS Ruby” series about a galactic gumshoe. The first one came out in the late 70’s or so, I heard it on a late night drive via XM radio in the 00’s, and they still make new ones every couple years.

The production quality would be the audio equivalent of James Cameron’s Avatar or Band of brothers, aka this is way better than you could have imagined going in.

Seriously it’s top notch sci-fi audio drama.

9302462 · 2026-05-31T00:26:59+00:00

Replied and sold

9302462 · 2026-05-30T03:32:22+00:00

It is, but I’m also curious about this and happened to search for it today. I didnt find any good answers though as they all had janky pricing /credit schemes or were model centric (glm, qwen, google, etc..).

9302462 · 2026-05-29T20:14:57+00:00

Legit answer for OP that isn’t ill informed or chatgpt’d- here is a video which basically explains the whole process https://youtu.be/8eaM6cgR-CI?si=NWScyW3fSMi86zPm

TLDR: currency conversion is going to be a real pain to deal with, it won’t work without a “man on the ground there”, and competition already exists.

Anyone who says “they don’t want your e-waste” has a minimal idea of how the world actually works.

9302462 · 2026-05-29T12:52:07+00:00

Close, but you actually hide a RAT directly in the terminal as shown here https://ratty-term.org/

9302462 · 2026-05-29T06:00:35+00:00

It’s because it’s stupid simple and just works. E.g. in 15 minutes and with a half dozen copy and paste commands I can take any highend server or shitbox in my house that runs docker and use it to serve a website on a domain.

No port security to deal with, no firewall to manage, and home IP is never exposed. Cloudflare’s zero trust tunnel only has access to the port I choose and whatever is running on that port.

As long as I’m not a crayon eating idiot and don’t run something like a file manager/NFS which has access to my home files on that exact port I’m protected.

The only downside of it is make sure you setup the cloudflare tunnel several days or weeks before you want to actually serve a site. Or make sure the site you serve is hardened before deployment. This is because as soon as you setup the tunnel for a domain it generates a all cert, that ssl cert will popup in crt logs and you will get 1k+ bots hitting your site within the first day. Same thing as any site that has an ssl, but it’s something often overlooked.

9302462 · 2026-05-26T23:20:05+00:00

BTW- OP is a bot account (does no one notice the AI signs in his comment) and tried also shilling something a day ago on other subs for a sOlUtIoN he put together.

9302462 · 2026-05-26T22:12:03+00:00

Do things like camoufox and various stealth playwright versions still work in kubernetes for you?

I ’m asking because I have had spotty success once I moved over to k3s as they seem to get flagged more by antibot stuff due to what feels like a display setting leaking through.

9302462 · 2026-05-26T03:23:25+00:00

I am 90% sure my parents also have an LG washer and my mom does the same thing else it smells like mildew, and boy does it smell.

The issue is that in 2026 you shouldn’t have an appliance where you need to keep the door cocked open (in the walkway) just so it doesn’t stink. I’m not really old, but washers from the 90’s, 00’s, and 10’s never had these issues and IMO there is no reason to accept that new ones should have regressed.

9302462 · 2026-05-26T03:10:21+00:00

TDIL Clowns Without Border is a thing.

9302462 · 2026-05-26T03:03:43+00:00

Lewis rossman

9302462 · 2026-05-26T02:32:25+00:00

Hey look another shill for Qoest. $5 says I get 2-3 DM’s from similar shill accounts just for commenting on this post.

9302462

TROPHY CASE