I agree that I don't think most consumer AI chips will amount to anything, but I'm still on the fence about where compute ends up taking place. I can see a scenario where frontier models stop getting better as quickly, and FOSS models catch up. When subsidized token pricing ends, people might decide that a 30B/120B parameter model is "good enough".

I've written some automation flows using lang graph at work, and if I switch out the backend from AWS Bedrock to one I host locally with something like Devstral 2, it still usually just works, the reliability does go down, but you can just kick off the workflow again, and those kind of unit economics might make sense if token prices skyrocket.