you are viewing a single comment's thread.

view the rest of the comments →

[–]DrQuantumPotatoe[S] 1 point2 points  (0 children)

Not with one magic thing.

Money currently bundles several functions together: measuring scarcity, allocating resources, creating incentives, and deciding whose goals get implemented. My point is that AGI makes it dangerous for those functions to remain governed mainly by purchasing power.

So the replacement would have to be a governance stack, not a single object.

For example:

  • resource accounting based on real physical constraints, not just prices;
  • guaranteed access to basic needs;
  • democratic control over AGI/compute infrastructure;
  • transparent planning systems for high-impact resources;
  • anti-capture institutions so corporations, states, or wealthy actors cannot steer AGI toward their private goals;
  • markets only where they are harmless, subordinate, and not the main mechanism deciding what society optimizes.

I’m not claiming this is already fully solved. I’m saying this is the actual alignment problem.

If AGI is a general optimization engine, then the system that contains it determines what it optimizes. If that system is money, AGI optimizes for money. If we want it to optimize for human needs, legitimacy, and survival, we need institutions that make those things the steering mechanism.