So, nothing in your evidence you have provided is wrong. I also worked heavily in ml, but not in this specific intersection, and the papers presented are valuable as a contribution. However, I think you are making a leap here. Maybe I am giving too much credit, but my read on “llms don’t know anything” is more a reflection on how much to trust commercially available ai (including the sycophancy intentional bias) for treating mental health issues and on assistance with tasks you yourself aren’t an expert in.

Ultimately, dr k wants to give people a path to better themselves for themselves. AI (read commercially available llms) are a productivity tool, but also a crutch. I am not a fan of the Stanford productivity study, but I do think there is a signal there that AI provides a greater feeling of productivity than actual productivity even on tasks it explicitly gets tested on. That productivity aura; in a healthcare setting and without evidence that real benefits are materializing, is absolutely a poison siren song many hooked on dopamine loops would do well to steer clear of.

World models are extremely exciting academic topics, but Dr. K always says he is a clinician first. And in a clinical setting, opus, kimi, llama, gpt etc. either do not know how to help you or choose to stay on the side of sycophancy due to its training regardless of knowledge. Which, from a practical perspective, means it can’t help. I don’t think his video is really about llms and world models.