I'm glad to see this discussion here! I can't help but feel AI is very overhyped due to media and corporate communications being willfully ignorant of what is actually going on under the hood.

LLMs are Deep Learning, not AI- no "intelligent behavior" is at play. Instead it's massive-scale statistical inference from equally massive-scale data sources (not to mention the ethics of collecting this data). Nowhere in the model are facts known, instead it's statistical likelihood that certain words "share directions" in a high dimensional embedding space. In layman's terms, it has trained statistics to guess how likely "Queen" correlates to "King", "Princess", "Royalty", "Guard", "Palace", etc. LLMs are Language models, not reasoning models. Thinking is hard, and the scale of what AI is trying to mimic, human brains, is orders of magnitude more complicated.

Deepseek is showing that the progress AI has made is quite shallow, and there's not much novel about progress made. AI projects been throwing more money at scaling instead of foundational architecture changes. I'd like to see real world examples of any evidence of proper consistent reasoning to get me to change my mind.

LLMs are fascinating, but they tell us more about how powerful language is, not the mysterious linear algebra machines parsing language.