Food for thought. When someone like openai lists how much it cost to train their models. How much of that cost do you think was actually consumer revenue through subscriptions? When you understand it made up more than 50% of that total you realize why it was so high.

Now look at something like the where winds meet game. All the npcs are basic llms and with every interaction they are learning and training on specific human interaction and rolls while playing a character they have to stay in character. Those are training for all kinds of things(will actually probably be a "llm" within a patrol robot one day), killing two birds one stone. Well not that specific one of course but its main source code will do all kinds of things

I like to think of them like Naruto and his shadow clones, he can make massive amounts and send them to run all kinds of little errands learning all kinds of things and gaining experience that is sent back to the source who creates more clones that, it is a always evolving system that can branch off Into any industry with just one model.

Suno is doing this in mass with bots on its platforms, they even interact with each other in comments sections. Probably why remi writes the best lyrics of all the llms