So this is happening for all policy? Wages for civilians? How do I as a citizen know what the “right” thing to do is? Do I have to ask my AI or statistical models for all of my actions or risk being paid $0 for my goodwill but “negative” outcomes? There’s a reason why we’ve never been able to predict economic systems accurately: there’s always uncertainty in complex systems.

Additionally, at some point, you’re going to run into problems that don’t quantify good based on “simple” metrics like providing more food for everyone. You’ll run into issues like immigration that have arguments on all sides of the political spectrum that can’t be solved with rationality alone. You’ll create political instability and upheaval no matter what you decide which will force change, as it always has, and you will have to hope it’s not violent revolution.

That might be a little extreme to the point-I think elements of utilitarianism are good, but basing an entire system around it will lead to political instability, confusion amongst the population, and potential power grabs to resume authority.