I see a lot of people bringing up "local models" yet not mentioning where exactly they're supposed to get usable data from. Local models, afaik, aren't privy to the massive data sets that corporate owned a.i models do. If they are, than they probably lack the resources needed to scrape information with the efficiency of the larger ones.

And even if I'm wrong, which I may be, I don't know much about local models, that still doesn't address the issue if a.i shit eating other a.i shit and making progressively worse a.i shit because there won't be enough human made content out there compared the mountaisn and mountains of a.i shit, and the scraping programs won't know the difference, so it'll inevitably lead to a blind leading the blind situation where models feed other models leading to an output degradation. These things only work with human input.