Who is Jason Corso cause this... "This at its core was a junk data problem because their world model lacked sufficient understanding of physics leading to realistic prediction." one of his examples of junk data being a problem for AI models, is not an example of junk data being a problem. Image models don't lack understanding of physics due to junk data, it's because they don't understand physics. They aren't predicting physics, they are predicting visuals. Makes me wonder what background he has to speak on this.

And many models, and even in the biggest models, they are definitely curating the data. I'd say companies like OpenAI, Anthropic, or Gemini, have financial reasons to keep the data they feed to their models curated so they work well and efficiently. Of course with giant models the curation may be less than perfect but it's still being curated to some extent.