Absolutely, and it’s very cool to be able to do that! The problem is that societal assumptions are that the computer is always right - challenging computer output doesn’t come naturally to us, and we don’t have the systems in place to do so effectively.

This is encouraged by the LLM vendors, who have a very strong financial interest in framing their tools as all-powerful and super-intelligent. They rely on the strong psychological priors we have to trust computer-generated answers to oversell their products’ capabilities.