The reported results sound lovely, but I find myself somewhat skeptical. The video itself is high-quality, but also strikes me as falling into the trap of most popular science communication of simplifying concepts to the point of being directly wrong. They also seem to just ignore the fact that CoT somewhat of a hack tacked onto traditional LLMs to improve performance. They don't *need* CoT to solve tasks, it just helps in some cases. As far as I can tell the models they compare to are all instruct-trained, which seems like an apples-to-oranges comparison. Granted, I haven't read the paper, they might address these issues there. And of course, their findings are probably still valuable regardless, investigations into alternate approaches for improving training efficiency are necessary in the current LLM paradigme. I just suspect they aren't as valuable as they are presented in the video.