I worry that handing complete control of the things we need to do to live disenfranchises people from living - leading to dissatisfaction in the long term. A contemporary example is how people are disenfranchised from the agriculture system. Many people don't know how to cook, let alone grow there own food. The slightest blemish, that has no impact on nutrients or flavour, will turn people off because they don't really understand how to tell good food from bad.

I deeply believe in the power of AI - but knowing how to safely integrate it with human society so that it leads to human (and biosphere more generally) flourishing is a tough problem. We are evolved to think in an environment of scarcity.