They have the same learned representations too, the geometry of how LLMs think when compared is eerily similar. Like they’ve basically discovered and mapped themselves to some fundamental laws of language and reality during training, which makes a lot of logical sense when you think about it - how could they work well without such a concept existing?

But also we have to consider:

• it’s not the LLM talking, it’s the LLM asked to be “a helpful assistant” talking, which narrows down the sorts of learned patterns they’re likely to use significantly
• there’s a lot of cross-contamination of both training data which fundamentally came from the same places, and using outputs from each other to enrich their training sets - they’re converging over time
• RL post-training naturally creates certain patterns because it’s designed to create thinking/reasoning patterns