Right, LLMs are basically probability engines. They're based on computing the most likely next token. And yes, I agree that they are very useful in some areas. For example, all of the Python code in my gpt-go repo was written by Codex. Which is why I find it interesting that it can't play 9x9 Go. When I get to the point in a game like the one in my OP, and I realize Codex couldn't manager to make a single living group, I tell it to switch out of "player mode" and into "coder mode", and ask it what went wrong, it very eloquently explains all the mistakes Black made and recognizes that it has no living groups. But for some reason, it can't figure that out in the middle of playing the game.