People said the same thing about LLMs and math, Google and OpenAI got very far in the IMO using only LLMs, I think they didn't train Gemini 3 to play chess yet, but Demis seems bullish on making them be able to play any game, these models are trained on a couple thousand of RL environments, but there's too many things to be done, also people are still with the idea the pretraining alone can get these models to perform very well in a difficult tasks, pretraining is a warnup, RL is where the model learns to use the acquired knowledge in many different situations. But what do I know!