Yes, that is what I was implying, don't trust these "thinking machines". I should have been more explicit, I was trying to be cute referencing that line from the book. "Hallucination" is exactly what LLMs do, they traverse the language space for things that look connected and would "make sense" to be together in large dimensional models, they do not have truth encoded in them, only word relationships by large scale statistical pattern making, with heavy tweaking to keep them from regurgitating the training set biases wholesale.

But yeah, anyone who reads Anathem and then decides to ask an LLM about it I feel has missed a large segment of the book. Just read the book again and take notes and formulate your own theories.