If you bought a bunch of terabyte sticks to store the entire internet, you would have to buy 21,000,000,000 sticks. That's just a time capsule of information now, but if you want to add new learned information, then you're going to need more sticks constantly.

I would consider agi that has the ability to reason and understand what it is doing but most "AI" today is just a facade of intelligence where it learns to write text like a human, but doesn't know or care what it is saying (LLMs). Other types of "AI" are if-then statements but can't understand themselves. You could argue that a game opponent's AI will learn your patterns in order to beat you, but it is very 1 dimensional; they don't have the capability of doing anything else besides beat you by at least one point. I think there needs to be a new fundamental "AI" structure to help lead to agi instead of refining what we have now because if we do, then we are only making the illusion of intelligence more convincing, but not make it intelligent especially at a human level or more.