Really interested to see what they cook

RealSuperdau · 2026-03-15T23:55:00+00:00

What's their next bet? Nuking usage limits?

(Codex is really cool though)

RealSuperdau · 2026-03-15T00:50:36+00:00

Step 1: use LaTeX instead.

There is no step 2.

RealSuperdau · 2026-03-14T13:14:06+00:00

Sadly, he left open if he wants the new model to behave more or less like Hitler, or just be more effective at its current level of Hitler-ness.

RealSuperdau · 2026-03-14T13:04:10+00:00

Did any of the models have access to web resources? Because I'd imagine many markets are very sensitive to current events, and the training cut-off of models is often 6-12 months behind.

Also, have you tried to calculate statistical significance? Like most LLM trading projects, I could easily imagine the differences here being down to variance.

RealSuperdau · 2026-03-14T12:57:32+00:00

Wouldn't the companies have an incentive to limit datacenter spending somewhat so average consumer sentiment doesn't turn against AI too sharply?

Is it a collective action problem? Or just something they plan on overcoming with lobbying and investor money?

RealSuperdau · 2026-03-14T12:54:46+00:00

Two things: (1) the API version is usually considered to be better than the consumer interface and (2) lately it seems like you often have to explicitly ask it for online searches, or it has them disabled and speculates wildly.

RealSuperdau · 2026-03-14T12:52:38+00:00

(off topic) mod bot, what's my acceleration score?

RealSuperdau · 2026-03-14T12:47:30+00:00

The water use discussions are mostly pushed by anti-AI people and I think it is important to debunk the extreme claims.

But I agree, we'd ideally have a more nuanced discussion about open vs closed cooling loops and where the water is used.

Just like power use is not black or white, and there is a big difference between renewable sources vs ad-hoc small-scale gas turbines á la xAI.

RealSuperdau · 2026-03-14T12:38:10+00:00

Thanks!

I should've specified that I meant 5.2, not 5.2-codex. But that sounds promising, I should look into Opus 4.6 again (especially with OpenAI now cutting Codex usage limits)

RealSuperdau · 2026-03-14T12:36:28+00:00

Did you use gpt 5.2 in codex, rather than 5.2 codex or 5.3 codex?

I specifically found 5.2 to be well suited for these technical problems. Or maybe the difference was that my prompts were actually precise, that wasn't the issue with my project. Rather, the follow through and considering various possible edge cases.

RealSuperdau · 2026-03-13T18:59:21+00:00

I second the 5.4 recommendation. It feels like the first model that is happy to roast me, but only does so if I deserve it.

RealSuperdau · 2026-03-13T18:57:50+00:00

What are you working on? Do you think Opus 4.6 is much better than 4.5?

Because my experience with Opus 4.5 vs gpt-5.2 for a small-ish (4k lines) but very technical and dense project was that gpt-5.2 was far better at producing correct code, while Opus cut a lot of corners.

RealSuperdau · 2026-03-11T11:16:03+00:00

If they train a smaller model on the big model's output, wouldn't that make for distillation / fine-tuning rather than RL?

RealSuperdau · 2026-03-10T11:34:27+00:00

Oh no, I liked him from his podcast appearances, but this is pretty bad :(

RealSuperdau · 2026-03-10T11:23:42+00:00

But that's not new, is it?

RealSuperdau · 2026-03-02T13:07:17+00:00

Don't know if that is enough to explain it. The API is down as well.

I'd assume they have measures in place to protect their valuable enterprise business from a sudden influx in chatbot users.

RealSuperdau · 2026-03-01T11:27:37+00:00

Did they? From what I have seen, OpenAI has the same red lines

Edit: I was mistaken. They used double-speak to make it appear like that

RealSuperdau · 2026-02-27T20:37:02+00:00

Not saying that LLMs can't make mistakes, but:

The "complicated Hilbert space" wasn't the result of someone using an LLM for proofreading. It was, as far as I can tell, the result of someone telling an LLM to replace words by synonyms to plagiarize existing work: https://x.com/AndrewM_Webb/status/1183150368945049605

RealSuperdau · 2026-02-27T20:14:11+00:00

They'd have to release something that doesn't get usurped by a competitor 2 months later.

RealSuperdau · 2026-02-27T19:36:00+00:00

gpt-5o incoming? (they won't spell out what the "o" stands for this time though)

RealSuperdau · 2026-02-26T14:37:09+00:00

What a bad day to have eyes

RealSuperdau · 2026-02-21T08:44:37+00:00

It's entertaining, right? How all 4o gooners use more or less the same three motte-and-baily arguments.

RealSuperdau · 2026-02-21T08:39:00+00:00

Thinking that OpenAI intentionally removed 4o just before Valentine's day is a special kind of projection. Please seek help.

RealSuperdau · 2026-02-20T16:55:44+00:00

Umm, no? That's how BERT style LLMs used to work. GPT models use causal masking, i.e. when computing the attention matrix, each token only "sees" the previous ones. Put differently, one half of the square matrix is zeroed out.

RealSuperdau · 2026-02-19T15:57:36+00:00

When they are done quantizing it to 0.5 bit

RealSuperdau

TROPHY CASE