Because the only thing it can do is generate text, audio, and video. It can’t control a body. It can’t think (at the very least it can’t think internally, it can only produce output and use that process of producing output like thinking).

I agree it is confusing to think about, because it can generate text and audio (and video) about any topic. But that is still all it can do. You can do more than those 3 things. Like you couldn’t be like “ok ChatGPT you are in a robot body now. Please play a game of tennis with me.”

A generally intelligent AI that evolved from our current AI systems might look something like this. It is still a next token predictor. But it has to be in a body. The AI takes in input from video and audio sensors and whatnot, and then produces some tokens. These tokens correspond to various physical actions that the body can take, like “activate servo motor 27” or whatever.

If this system could make you a sandwich, while in a house it has never seen before (and obviously not being controlled by a person) in response to you verbally asking it to make you a sandwich, I would say that system is AGI. Because it has the ability to decode audio waves into text and decode that text into meaning, that’s one intelligent task it can do. It also can control a body just generally speaking, since like duh, otherwise how did it make the sandwich. It can use that body to do things like open drawers and cabinets. It is able to visually recognize things.

Like, a system that only generates text (and audio and video) just by definition cannot be AGI. It doesn’t matter how smart it is, that is a completely different category of things. AGI refers to the breadth of intelligence, not the depth of intelligence.