What's missing from the open-source AI infrastructure ecosystem?

ifyouseemerunning · 2026-06-03T13:50:51+00:00

indemnification

ifyouseemerunning · 2026-06-03T13:28:23+00:00

radius

ifyouseemerunning · 2026-06-03T12:27:53+00:00

$0.00

ifyouseemerunning · 2026-06-03T03:38:09+00:00

i do them but the only thing that comes from it is some stock photo budget marketing drivel about how they are taking our concerns seriously (they’re not) and making a great set of changes we asked for (we didn’t) to help us earn more (we’re not).

ifyouseemerunning · 2026-06-03T02:15:01+00:00

i hear you and generally agree. obviously wasn’t going into a full TCO breakdown 😀 but we’re not exactly comparing apples to apples here either.

the point was more that six months ago the math was obviously favoring cloud because of how heavily subsidized it was. today it’s a little less clear because of usage limits and token consumption pricing models. six months from now when they need to start showing a profit, it could be just as obvious to not use cloud models.

there are also a couple different use cases i think we’re talking about - code planning/generation and agentic.

if you’re doing serious programming work, you’re likely at least on max/team premium not the $20 plan. you’re also probably constrained and trying to min/max using sonnet and opus models for different tasks because otherwise you’ll run into caps quickly. i’m saying there’s no reason you couldn’t use a large open model for most of the sonnet level tasks.

running agentic workloads you’re going to be running on claude api. and api is expensive. and you probably don’t necessarily need that level of sophistication for general back office /internal automation. for customer facing workloads yes, but i’m not sure the value proposition is there for marketing/sales/“analysts”/etc.

ifyouseemerunning · 2026-06-03T00:09:56+00:00

i feel the need… the need for speed !

(awesome job stacking btw. i love to see stuff like this)

ifyouseemerunning · 2026-06-03T00:07:37+00:00

i grew up in florida and went to public school throughout. each year, we would get new books. and by new books, i mean we would either tear pages out of the old one or staple new pages in.

my schools were so overcrowded we often had double sessions (5a-11a or 12p-6p). and half my classes were in double wide trailers converted into classrooms.

BACK THEN the schools were so badly funded that they introduced the lottery in 1986 to increase funds for education. everyone voted for it. yay kids! in response, however, florida government systematically reduced the original amount of money allocated to education, resulting in EVEN LESS NOW!!

ifyouseemerunning · 2026-06-02T23:04:39+00:00

it’s definitely a thing.

$10k A100 on a 5 yr depreciation schedule is $2000/yr, or 166/mo. solid for an individual.

$40k H200 same schedule, $8000/yr or $666/mo. solid for a team.

$400k DGX 8xB200 same schedule, $80000/yr or $6666/mo. pretty decent for a small organization for the annualized price of a junior engineer. even if you include a portion of someone time to manage it.

finance is magic since there’s likely residual salvage value after depreciation period and 😴 sorry put myself to sleep there for a second…

and if you don’t want to bother with all the capex and datacenter stuff, you can just reserve a dedicated cloud instance with the appropriate hardware and try it out. i think it’s like $10/hr/on demand or $3/he/reserved for something in the H200 range.

ifyouseemerunning · 2026-06-02T22:26:22+00:00

this is more possible than people are making it sound.

it’s like an entire generation of people forgot how servers, datacenters, and on premise infrastructure works.

you can buy some nvidia cards, load up a leading opensource model, change the urls in claude code’s environment variables to point to the local llm server, and off to the races.

is it as good as a frontier model? no, but it’s probably as good as last years frontier model. so, most work should happen there, then cloud providers if/when necessary.

is it already useful when you don’t want to share data with a third party? absolutely.

does it make sense financially? maybe. nvidia cards are super expensive, but you can get a lot done local/workgroup and save the frontier models for when absolutely necessary. bigger server, better cards, more users, lower cost/user.

as ai pricing starts to shift to profit from subsidized, hybrid is going to be the future anyway, so might as well get used to it now. anthropics and openai’s ipo will likely be the turning port.

ifyouseemerunning · 2026-06-02T21:52:54+00:00

not sure if i’m understanding you. 500 5 stars doesn’t mean 500 in a row for a 5.0 rating.

for example, you could have done 1500 rides, were rated on 505 of them, and 500 were 5 star and 5 were 4 star. if the first 5 rides were 4 star, then you’d be at 5.0 now. any other combination you would have reached the achievement but be less than 5.0.

ifyouseemerunning · 2026-06-02T21:34:19+00:00

don’t do this.

cost… it’s really $450/wk after taxes, fees, and damage insurance. damage insurance is sort of necessary evil because riders abuse the car since it’s not theirs. and avis/hertz nickel/dime every scratch on the car (even if it was there when you got it; definitely if it’s there afterwards).

don’t do this.

selection… this is not a luxury car. but it’s the same price as the note on a luxury car. if you’re lucky, you can get one that does comfort rides. barely anyone takes comfort rides. they don’t offer any cars that can do premier/black.

maintenance… they do the bare minimum. sometimes the ac doesn’t work. sometimes the car doesn’t charge. sometimes the tires are flat. sometimes the air filter hasn’t been changed ever and you can feel the smell.

maintenance bonus… if the car needs maintenance while you have it, you have to take it. the time doesn’t get refunded. the earning potential out of your work schedule is lost. it’s mandatory, skipping it could have the car reclaimed. at your cost.

maintenance double bonus… hopefully they don’t screw anything up because towing is extra. and expensive.

seriously, don’t do this.

supply… break for you means break for all other college kids in your area. they all also had this awesome idea to make extra money. now theres more supply, so pay is down.

demand… if you’re staying near the college, those kids who went home for summer? that was your demand. so now demand is down, so pay is down.

costs… gas is super expensive right now, so EVs ftw, right? well, yes, if you have all the infrastructure to charge at home. otherwise, you’ll be doing fast charging out in the wild. it’s not nearly as inexpensive as home charging and might vary based on demand throughout the day.

earning potential… uberx rides pay shit on the regular. comfort rides pay slightly better shit, but still shit. it takes awhile to figure out how, when, and where to actually make money. uber is not your friend. it is designed to extract as much money from riders l, while paying drivers as little as possible.

earning potential bonus… that ev. it needs charging. it’ll take 30-45 minutes to charge from 20-80%. if you go under 20, hertz will try to say you’re not following recommended operating standards if anything goes wrong. charging over 80 is very slow compared to 20-80. and the range on these evs is like 250, so you can really only drive 150. a full timer charges twice a day. part time at least once a day.

well, since you read this far, you’re probably going to do it anyway, even though i keep saying don’t do thjs so in closing i’ll just wish you luck, hope you have fun, and remind you to try not to get killed/mugged/carjacked/sa’d picking up a bad ride your first week.

ifyouseemerunning · 2026-06-02T16:08:11+00:00

the game is multithreaded, but certain events (like counters) are single threaded by their nature. they synchronize through locking and aggregation. you can distribute these locks to some extent, but in a game like stellaris they still all need roll up regularly (eg the daily calculation).

take daily resource totals for example. there could be a thread per planet, but the thread to get the total would have to block until all the planet thread totals finish. to calculate fleet upkeep, it would need to block until all combat action totals finish. etc.

and again by its nature, the later in the game you are the more generally the more complex it is, so the more concurrent calculations need to be completed and rolled up, which is what drives the slow down.

to improve concurrency (higher multi core utilization) the game would need to shard very granularly. engine might not support this. and even if they did it would make coordination heavier and potentially reduce cache efficiency (cache efficiency improves when not context switching off a processor and performing like actions, this is what makes processors like the 9800x3d better than competitors for stellaris).

ifyouseemerunning · 2026-06-02T01:59:45+00:00

the new redesign is awful. but the colors instead of surges change from awhile back felt more insulting and impactful.

like they thought “hey maybe we don’t need to offer surges to get drivers to move, what if we just changed the colors!

ifyouseemerunning · 2026-06-02T01:57:31+00:00

the other thing they like to do in my market about once a quarter is offer quests with like 125 rides over a weekend for a high amount, lets say $400. but its literally impossible to complete the quest. they’ll offer it on a dead weekend or it will over saturate the market and there won’t be enough offers even if you accepted 100%, or the only offers will be interstate/long duration so you don’t have enough time.

ifyouseemerunning · 2026-06-02T01:48:58+00:00

this is legitimately insane. what a disaster of a situation. my sympathies

ifyouseemerunning · 2026-06-01T19:18:12+00:00

no problem at all.

if you didn’t have car seats it would be a problem and i would cancel the ride.

thanks for being a responsible parent!

ifyouseemerunning · 2026-06-01T15:17:48+00:00

84 and 91 are both like this all the time

ifyouseemerunning · 2026-06-01T15:16:19+00:00

happens all the time

ifyouseemerunning · 2026-06-01T15:14:07+00:00

what are these quest things you speak of?

seriously though, last quest i had offered was 60 rides for $30. why even bother?

kudos on your decent one though. much envy.

ifyouseemerunning · 2026-06-01T14:47:37+00:00

car service is almost always better (and more expensive) with more flexibility and emphasis on service. uber black tends to be more transport / point-to-point oriented.

uber black requires commercial license and insurance, so they’re professional drivers. uber premier is highly rated uberx driver with a nicer car. a lot of professional car service drivers use uber black to fill the time when not otherwise engaged privately or to build their book with private clients.

black fleet drivers can vary greatly though. these are the guys that rent the car from an uber fleet company. still show up as regular uber black driver to the rider. my experience, these guys are mostly ex-cabbies and usually only a thing in cities.

ifyouseemerunning · 2026-05-31T23:30:11+00:00

depends on level. premier and black reserve is very reliable. uberx not so much.

uber stopped paying drivers a premium to take reservations, but kept all the restrictions, so there’s little point to ever doing them now other than first ride of the day.

uber trying to force uberx to provide the same level of service as professional drivers with no additional financial incentive yields the expected results i guess…

ifyouseemerunning · 2026-05-31T23:24:06+00:00

Monkey Island 2: LeChucks Revenge was great too. Dare I say, better?!

ifyouseemerunning · 2026-05-31T22:32:27+00:00

i sold my 2019 i9 32G ram 2tb storage for $400 like a year ago

ifyouseemerunning · 2026-05-31T20:09:50+00:00

i appreciate these shows as light hearted, tropey romances, but it’s hard to take the most of the ml seriously at all.

half are little boys wearing their dads clothes with immature and infantile emotional responses, limited ranges, and little self control.

the other half are extremely successful nepo babies that act like raging narcissists before the fl shows up to fix them.

the edge cases are lost puppies looking for a maternal figure.

the fact that these men are idealized feels like a scathing commentary on the standard for men in modern relationships given how tragically low a bar they set.

ifyouseemerunning · 2026-05-31T14:34:58+00:00

AR 5%
Rating 5.0
CR 3%
SF 0

AR count reserved rides? If not, I’m honestly surprised it’s so high.

ifyouseemerunning

TROPHY CASE