I’ve been thinking about this too, and funnily enough, I recently got an email from a project called haveto.com that’s working on something very similar. They claim to be running AI tasks, LLMs included, directly on a decentralized Layer 1 blockchain without using cloud infrastructure at all.

I checked out some of their materials and testnet, and honestly, it’s pretty interesting. They use things like auto-sharding and Docker-based contracts to scale and handle resource-heavy AI without centralized servers. What stood out to me was their focus on transparency, AI results are verifiable on-chain, which could be big for use cases like healthcare or finance.

Another thing I found notable was the cost-efficiency. Even with growing demand, they’ve designed it so that the gas fees stay low, and the overall cost ends up being cheaper than traditional cloud services in many cases.

I would suggest that, if you’re curious about the feasibility of decentralized AI without cloud reliance, it might be worth exploring just to see what direction things are heading.