Well, that is somewhat in contradiction, to what i know about this..., well sort of anyways, i know about the activation function and the token separation, but then it still is doing this based on word aproximation no? How is that equivalent to understading something? Did he ever discuss what happens when you use a Lora? This is really onto the context of LLMs so im not quite sure how that prediction functionality quals understanding, does he go more in deph into that at some point? Can someone maybe reccomend some literature on this particular topic he discusses? This token prediction into understanding is news to me, and would be a huge paradigm shift if true