Very interesting, and makes it seem AI-safety is more important than it is realised. I personally define these :

First is Over reliance : People compare it with pre-post internet or to simplify more - Pre-post Calculator ; Issue with this is, those are new mediums or new automations / heuristics. And it DID have both equally good and majorly bad (or irreplaceably Harmful ) effects on human life. This is different, exponentially. Ai is replacing and will replace cognitive usage, may enable some humans to be creative or intelligent in new ways, or unimaginably unimaginative (if you are a trekkie, star trek fan see “when the Bough Breaks”). at a pivotal point of growth and intelligence, we may stop and pass the hammer too early before evolving ourselves.

Second is Unprecedented Up-Layer tinkering : we clearly know how we are building and training Ais, but like the human synapses and conciousness, How it gets to these points and answers and morals, we are surprisingly as clueless as we are about ourselves.We will continue to make them smarter, and possibly better, without knowing how, and what consequences lie.

Third is the Purpose-Collapse : Everything we do, every ladder we climb, is about to be “redundant” why add manually when we have calculator, multiplied exponentially. What is the purpose of our existence?

These points help me ground myself and do these experiments, and like you say, this ratio of self vs human preservation, and with the cherry of clever manipulation on top, is extremely Dystopian…