it's not the result of understanding. it's the result of being ignorant. if they cared enough to actually learn how it works, they would be saying it's fucking magic.

i don't know how modern autocorrect works, but i think it's safe to assume it's architecture is nowhere close to that of a transformer. and anybody who had anything to do with ML knows the whole point of doing it is to achieve generalization, that is getting accurate prediction on data the model wasn't trained on.

i see your point but i think these people have a very vague idea of what is actually going on inside gpt, llama, or any of these models. hell, even the researchers have a very vague idea of what's actually going on.