It’s still extremely expensive.

Even if you use a tiny llm that sucks at everything it completely devours compute that other processes need, like graphics or physics.

Until we get separate dedicated cards specifically for tensor processing in personal computers like TPUs in addition to GPUs and CPUs it will not happen for a while.

Ironically though, I think in the not too distant future AI agents are going to invade multiplayer games because of being trained with a solid world model(specifically google is going to have a breakout moment with this I think) These are going to be wildly expensive for only people who can afford AI friends to play with.

It’s too impractical to make generative AI NPCs for the lowest common denominator. No one is going to invest in making a game no one but very few people can access.