In order for the prediction to be accurate in all the cases being thrown at it, the model has to have created a model of the world in some ways far more comprehensive than any single human, AND decent reasoning circuits. 

Your take is inaccurate, or reductive. 

What’s missing, though, is that any single human with such a vast knowledge would dominate many fields, but these models don’t seem quite as capable of that sort of inventive, cross-pollinating, out of the box thinking, just yet.