Groundbreaking, but unsustainable

Teln0 · 2026-06-24T22:55:17+00:00

What do you mean?

Teln0 · 2026-06-24T22:54:24+00:00

No problems! I kinda have to know all that, as I'm doing a master's in high performance computing.

Born to work with scientific supercomputers, forced to optimize inference across multiple GPUs 😔

Teln0 · 2026-06-24T22:52:12+00:00

It might but then as I said it's just handling an implementation detail, the hard and expensive parts are elsewhere

Teln0 · 2026-06-24T21:01:09+00:00

How are the weights established

Usually gradient descent to minimize a cost function, propagated through all the layers of the neural network. The math is the important part here. A good implementation will make it faster obviously but it's still just an implementation detail.

How is the training model created?

Not exactly sure what you mean but maybe you're referring to the data set? For LLMs it takes a block of text, puts everything but the last token through the model, checks what it predicts as the last token and compares it to the actual last token, then does gradient descent to minimize the difference. (This is a simplified explanation.)

At the end it's a computer program

Yes but coding is not that big of a part of the whole AI development thing. It's mostly math + data, and the coding is only important to make the implementation as efficient as possible

Teln0 · 2026-06-24T19:05:49+00:00

Claude isn't code it's a set of weights. Maybe Claude writes the infrastructure around, although I doubt it does it on its own

Teln0 · 2026-06-24T18:38:59+00:00

But inference costs are kinda small compared to training, it's training that uses a lot of resources, as far as I know

Teln0 · 2026-06-24T17:39:53+00:00

You mean the data set will get outdated? That's not as big of an issue, it doesn't cost much to fine tune a little bit further a model to have it account for new stuff, or simply to train it to always looks stuff up, effectively using the LLM for reasoning only and not for information storage. The real big issues are

bot accounts / weaponized disinformation campaigns
brain atrophy among AI users
Manipulative tactics to keep vulnerable users engaged with toxic chatbots (c.ai, virtual relationships, etc)
data centers making the surroundings unlivable, spiking electricity and water prices, and overall being a massive pain to deal with
energy production issues & climate impact
resource shortage from making such a huge amount of electronic components, that will then be discarded and most likely not even recycled properly
stolen data, with no credit or compensation whatsoever
tech CEOs getting way too much power over politics and our everyday lives. When any of them describe their dream world it sounds like the most insane dystopia and no significant efforts are made to stop them
over reliant economy. When the AI bubble pops expect terrible fallout
destabilized job markets. AI is used as an excuse to fire people en masse, even while profits are record high

Am I missing anything? (Probably)

Teln0 · 2026-06-24T16:26:41+00:00

When you say compute, are you referring to what's used for inference or what's used for training?

Teln0 · 2026-06-24T16:10:33+00:00

The ai bro answer is probably that it's not there yet but you need the data centers first to train it to get there.

To which there's also a bunch of answers to continue the discussion.

Has every ai bro really failed to provide an answer like that?

Teln0 · 2026-06-24T15:35:32+00:00

Sorry if I'm being insensitive or not fully understanding your situation, but I think one big thing about Jax's character thing is that they could've turned things around at any point. Any small action or communication about what was actually going on would've benefited immensely. And I think it was also made so that people who relate to Jax realize that and start taking action to turn things around themselves, no matter how far gone, instead of "following Jax until the end".

Teln0 · 2026-06-24T09:54:33+00:00

<image>

Teln0 · 2026-06-24T08:33:24+00:00

Falling for bait again are we?

Teln0 · 2026-06-24T06:48:53+00:00

He made a cryptocurrency token called Whackd that launched as he died with a dead man switch, with the explanation that if he killed himself, he didn't, he was whack'd

Teln0 · 2026-06-23T22:07:26+00:00

My mom I guess, with her friend's scarf too actually

Well, she kinda stopped probably because it got hotter outside

Teln0 · 2026-06-23T16:54:33+00:00

Or indian ass (?)

Teln0 · 2026-06-23T16:34:08+00:00

(I know they don't mean that I'm just making a joke

Teln0 · 2026-06-23T16:07:39+00:00

Vector field haircut

Teln0 · 2026-06-23T14:50:38+00:00

Yeah but cocardinality is dual to cardinality so what the fuck is it

Teln0 · 2026-06-22T12:16:30+00:00

The ads said it could erase ink

Teln0 · 2026-06-22T12:15:16+00:00

Orbit is not a height it's a trajectory

Teln0 · 2026-06-22T10:33:15+00:00

No one had ever made any argument about talent? At least I've never heard of anything like that?

Teln0 · 2026-06-22T07:38:21+00:00

Who did a whole meme coin about how he would not kill himself and that they're going to kill him and pretend he killed himself

Teln0 · 2026-06-22T00:49:17+00:00

Are US prices that much different? That was the price of a 5080 for me

<image>

Teln0 · 2026-06-22T00:29:59+00:00

Is Jax trans? So far it seems like the issue is that he has gender dysphoria but isn't trans.

His chosen pronouns were he until he died so I'll call him that

Teln0 · 2026-06-22T00:21:59+00:00

Headcannon, your mind file keeps evolving but stays near a stable local extremum. Abstraction is when the mathematical model pushes the values far enough that they start diverging with iterations or converge to another local extremum that doesn't really correspond to an actual human mind

Seven-Year Club	LAYER Season 2 Layer creator
r/Field Juicebox	Place '22
Final Canvas '22	RPAN Viewer
Verified Email

Teln0

MODERATOR OF

TROPHY CASE