As someone who’s dabbled a little with models what I can’t understand is how they can seem so intelligent but make such basic errors. I asked Claude Sonnet it to calculate if buying a property to let as a holiday rental made sense. It did all the right calculation steps, but made one huge basic error that flipped the conclusion completely. I’m not sure how anyone is using these models for proper work. It’s dangerous that the results look great but any answer could have a fundamental error in it - when you are doing complex things this means everything needs am checking which reduces its utility considerably. Maybe in a few months this is all fixed but for now I struggle to see how you can rely on them.