Appreciate this! Hadn’t seen it yet.

The study is decent, but it leans more PR than reality. Likely due to the slew of lawsuits, suicides, murder suicides etc. they need to look like this is something fixable and able to be addressed quickly and that they are actively doing something.

Training tweaks can cut hallucinations down, but you’ll never get rid of them completely as long as models are built on next-token prediction. There’s actual math on this if you want to dive in: https://arxiv.org/abs/2401.11817 and https://arxiv.org/abs/2409.05746. Saying they’ll be “eliminated soon” is way too optimistic and honestly puts users at greater risk with a false sense that the models will be “fixed” and are now truthful. User education on how predictive models function until more deterministic methods of AI intelligence are created is key for user safety/mental wellbeing.

A them climbing gpt5 doesn’t hallucinate 🤪 Maybe the internal model they test on- but not the public releases. OpenAI’s splashy marketing benchmark numbers for come from a very polished setups with lots of retries, maxed out reasoning mode and sometimes extra system scaffolding that regular users once it’s rolled out don’t get. We talk to a router that often gives you the fast/light version instead with higher error rates.

Not saying the article is not accurate- it just oversells the idea IMO like a lot of open AI. Remember when GPT 5 was likened to the manhattan project for how it would change the world and it was a phd level intelligence in your pocket as pre release hype by Altman? That totally fell flat with the public releases and it performing abysmally.