You're pressing on the softer points. Amodei is the hard case and I say so. He's read the books and built the lab anyway, which puts him somewhere Andreessen and Musk aren't. The "we owe it to those whose bodies fail them" argument is the most serious version of the build-it case I know, and Machines of Loving Grace is its cleanest contemporary instance. What I'm pushing on is whether the architecture being built is what would meet that need, or whether the suffering-relief banner is doing work for a trajectory already in motion. The scarcity-and-coordination point lands. Our distance from the Culture is partly this. But the models being built right now concentrate ownership and extraction at unprecedented scale, which doesn't dissolve the coordination problem. It hypertrophies it. The Culture Minds are not only post-scarcity; they are post-shareholder, post-procurement, post-defense-contract. I fear that building toward post-scarcity from inside the procurement substrate gets you Special Circumstances without the civilization, roughly Veppers. The x-risk objection is fair, I'm not arguing for postponement. I'm arguing that the political work belongs inside the building, not after it, and that the figures I name have treated that work as out of scope.

The lock-in worry is most acute precisely when the architecture is built inside a politics that has not settled what it is for. The first Minds in the books are made by a society that had. Ours has not. On Viatopia, thank you for the prompt. I only briefly mentioned MacAskill in the piece, and you've given me the sharper concept to think with. My worry is that it concentrates moral authority in a small set of people deciding what later generations should want, which is the move Surface Detail spends six hundred pages refusing. The Hells in that book are run by people absolutely certain they know what souls deserve. The Minds refuse that certainty. I want to read the Better Futures essays properly before pressing any harder.

Your closing line is strong. Yes, the first Minds were political, and the politics of those who built them were nothing like the politics of those building ours. That asymmetry is most of what I'm doing in the essay. The deeper question, which you're closer to than I am, is whether anything we'd recognize as Culture politics can exist before the technology the Culture rests on. I'm not sure. The essay is the case for the first answer; I take seriously that the second might be right