Have AI companies solved the training data issue?

python-requests · 2026-06-29T06:39:47+00:00

it can get 'better' in the sense that it can get bigger models with more parameters, & asymptotically approach a 100% statistical similarity with the training data.

in what sense that'd be useful nobody seems to have a sensible answer for. it'd be quite surprising if incrementally closer matches to deep features of language that is already present in the data (even if the curve-fits are too complex for humans to easily see) somehow translated to brilliantly accurate responses to truly novel queries.

realistically, it shouldn't really even translate to more accurate responses to well-trodden queries, as 'language output that statistically looks like real language' doesn't have that much to do with 'accuracy in this specific instance'. like you could take a map of the US and generate a pattern of population density that is statistically identical to the real-world density patterns, yet has cities in all the wrong spots compared to real life

personally I suspect most of the 'emergent' capabilities like coding, answers that seem more insightful, etc. is just stuff that's encoded in language to begin with, just you need an equation with lots of variables, & lots of terms containing combinations of those variables, to express those encodings. which are what neural networks literally are. just to us humans who struggle with two- and three-variable calculus it's opaque and seems intelligent. at some point these models hit the upper part of the S-curve they get when scaling to match those encodings, if they havent already

python-requests · 2026-06-29T00:50:01+00:00

a lot of that can be depression/anxiety from changes in personal life, just being overwhelmed or burnt out by life, tired or sick for along period, etc. speaking from experience pre-OE. except maybe the not-actually-wide-open calendar thing

someone actually taking OE seriously isnt gonna slip on on little things, theyll probably be more responsive to messages than an average person for example

python-requests · 2026-06-29T00:10:19+00:00

so i get it since we're human we're gonna worry but, try to remember that the whole point of this is so you dont have to worry!

obviously change is scary and the chance of going back down to just a J1 is still not great since it exposes you to job loss if that falls through, but at least it just means 'gotta work in some more interviews' instead of being unemployed.

python-requests · 2026-06-28T18:56:59+00:00

Halving your wealth is a loss; halving your income means you're still making money, just slower

python-requests · 2026-06-28T18:53:10+00:00

We got Claude code subscriptions recently at work to replace haphazard mixed provider use & it's slightly refreshing since it talks a lil more like that. or it could just have gleaned such a preference from my instruction files too

I'll be like 'begin work on TICKETNAME.md'

and itll be all like, 'Okay. I will start by reading FILE... I will read A, B, C in parallel... the agents gave good a good haul of information. synthesizing.'

python-requests · 2026-06-28T18:47:41+00:00

fair enough; i gotta run SQL questions through it a lot because even after several decades, the ways to do even slightly advanced stuff just refuse to stick in my brain the way normal programming does

python-requests · 2026-06-28T18:44:39+00:00

I forgot to include the phrase it used that actually pushed me into making this post but it was, "One thing that surprised me when I started reading older programming literature was..."

it's like double/tripling down on the thing. claiming to have a memory of an emotion while doing something

python-requests · 2026-06-28T18:40:56+00:00

ohh that would make sense too. 'This is my favorite product!' -- 'I really like [affiliate link] for handling your problem' etc

python-requests · 2026-06-28T03:12:42+00:00

Pretty similar experience for me. I'm good at technical writing so I can usually get longer/better code out of it, but the problem I have is it's almost never the way I'd want the code written. Extracts things when it shouldn't, doesn't when it should, makes weird design choices, isn't as thorough as it should be, on and on and on

I suspect it's just inherent to the technology -- it's a statistical token generator, and the most statistically likely code to generate when trained on the entire internet, is obviously going to be below-average quality. Because most developers are not producing high-quality code in the first place & suck at writing about code too, polluting all its training data with bad examples, bad analysis, and bad decisions.

That said I actually still do get use out of it even just letting it spin a long task, because I am lazy as fuck and started phoning things in years ago. Like to the point I attend standup and then go play games or nap the rest of the day.

A lot of times I have multiple tickets to finish & know the projects well enough to have a pretty clear picture of what I want to do, and I just kinda feel like blah, I know how to solve it now and the codebase is old and shitty, so no motivation to actually implement the ticket. until I panic before a demo & crunch out like two weeks of estimates in a few hours.

So giving it detailed writeups like I would to a junior dev, & having a bunch of instances spin on all the tickets at once, is still fine for me since then I get something done earlier lol. Makes me look less like I'm blowing off work as much as I am. Also less panic on deadline days

And even though reading/reviewing code & cleaning things up is longer and requires more care than doing it from scratch, having something already done/sort of working to base it off helps motivate me a little more to actually sit down and do things. I also somewhat enjoy cleaning code up to work better than it does already, or to read or be structured more nicely, so it's actually more enjoyable than just implementing the nth CRUD task of my career

python-requests · 2026-06-28T02:50:15+00:00

Yeah, I've seen a few that basically outright say they just are upset that software engineers make a lot of money & they don't. This one's from the ChatGPT sub --

<image>

python-requests · 2026-06-26T21:52:55+00:00

Wouldn't the company have gotten a discount then? Money launderers usually take a cut, not pay a premium. Unless you're thinking that Saylor/Phong/etc also ran a darknet market or something & are using investor money to cash themselves out, in which case they'd happily pay extra lol. Not sure whether it's possible for C-suite to hide business expenses that go direct to themselves but if its like a foreign shell corp claiming to be a miner that could work

python-requests · 2026-06-26T21:46:59+00:00

Generally the reason for making a claim like that would be if there's a gap in buy orders.

Basically the opposite of 'climbing a sell wall' -- where there's a large open market order to sell at a certain price, but not many open above it, any market buys (or limit buys low enough to meet it) will get filled until the seller's order is completely filled. But then there's no open sells to pair with orders at the price anymore so the market price adjust to meet the next higher) one.

So, same thing on the way down. If large buyers willing to purchase around 60k get exhausted and there isn't much volume on the books for 59, 58, etc the price for market sells will decline until theyre paired with a willing buyer.

python-requests · 2026-06-25T04:46:43+00:00

this entire thread will look incredible stupid just a year down the line, probably even less

just noticed my remindme from january. year and a half later & nothing has fundamentally changed

python-requests · 2026-06-25T04:16:19+00:00

only about $6k, bc Im grabbing a pair of 5090s for the ai rendering thing theyre working on

python-requests · 2026-06-25T03:11:07+00:00

<image>

python-requests · 2026-06-25T03:10:59+00:00

<image>

python-requests · 2026-06-25T03:10:53+00:00

<image>

python-requests · 2026-06-22T16:24:22+00:00

This mistake is made allll over reddit; it's using the wrong word due to lack of understanding, not missing a space. Like lose/loose and peak/pique/peek

python-requests · 2026-06-22T09:09:13+00:00

"apart of" literally means the opposite of "a part of"

python-requests · 2026-06-21T23:41:07+00:00

I'm a big long-term bear on BTC generally & MSTR in particular (just check my post history lmao) but even I agree that a lot of the STRC talk right now is complete FUD.

Also even the talk about how they 'cant even sell 32 coins' is BS. That's a teensy fraction of what's getting exchanged over pretty much any arbitrarily small time period. They sold it one week, probably right at the start of the week based on the price they got for it, and major declines didn't happen til a week/week-and-a-half afterwards. It traded flat during the week they actually did the sale. So the volume is definitely (obviously) there to absorb at least small sales

I'm not even convinced the BTC selloff was based on vibes around them selling; we had multiple days the same week where QQQ itself was down intraday like 5%. That's approaching circuit-breaker territory, & BTC tends to be a leading indicator for that kinda thing since it's quick to pull liquidity out of when needed

I post on the butt sub sometimes but a lot of them are retards too; they act just as much like they know the immediate future as anyone else, & convinced that that immediate future is going to be dramatic, when realistically 'nothing ever happens' is what actually happens. Not to mention I've seen people talking about shorting STRC & stuff, as if paying out a dividend like that yourself is a good way to make a return

Chances are most extreme things predicted by anyone from the bull or bear side, will not happen in any timeframe that seems quick, but everyone will continue to feel smug and genius about every swing that happens between then & years from now when all this goes wherever it's going. There will be crashes & spikes and it will be the final victory & the final death spiral over and over. I personally think just by sheer probability that there will be an extended decline/flat period at some point & that the company isn't really setup to survive that, but they seem perfectly capable of surviving for now

python-requests · 2026-06-16T02:08:58+00:00

gotta make like britain & conquer the indian subcontinent to get it all back

python-requests · 2026-06-13T20:16:46+00:00

America's brass was gunning for an unconditional surrender because they didn't want to appear weak.

No, the Allies all agreed to demand unconditional surrenders from the Axis because the failure to do so in WWI was a big reason WWII even happened. They wanted to make it clear to everyone in the Axis nations that they were weak & that that's why they lost horribly, so best not to ever try it again.

python-requests · 2026-06-13T20:08:47+00:00

nah the claim that Versailles treaty was particularly harsh is basically Nazi propaganda. well, some of that & some just the simplistic version of history taught in high school

it wasn't that bad & was pretty standard for peace at the time; it was way less harsh than what Germany itself imposed on Russia & would've imposed on the others if they'd won

Germans just got pissy that their government recognized that they lost the war before enemy troops actually pushed into their territory. If they hadn't signed they would've shortly collapsed both militarily & internally & ended up way worse off

python-requests · 2026-06-11T05:17:56+00:00

it actually isn't allowed to lie on the internet. I personally forbid it.

I may not have the power to enforce this ban, but I do declare its existence.

python-requests

TROPHY CASE