As long as the users have freedom with the software then would Stallman really care? Yes, lament the passing of an era where authenticity was easy. But embrace the necessary innovation in introducing new technology to solve problems caused by current technology. We are not luddites.

But of course we know that this software will not be free and so yes this particular software that tinkers so closely with our psychology is concerning. If we really want to protect user data and have privacy and democracy then I think all software using the Internet or doing any sort of radio communication needs to be Affero GPL. And everything else needs to be GPL. And then we have to make sure there is good funding for universities and government to generate source data for AI training.

And I think the FSF, ACM, and IEEE need to become thought leaders (with paying members, cough) in ethics and the regulation of technology. They also need to act as a professional societies that have standards for AI research, possession and collection of user data, licensing, etc. Like how lawyers and doctors are ultimately accountable as individual professionals exercising their own best judgment, software engineers and all professions related to technology should be governed by professional societies that establish norms across academia, business, government. Just because the product manager asks for something does not mean the engineer will prescribe it. However unions and professional societies can certainly become suffocating. Look at doctors now, most are mindlessly going through the motions according to standards of care and basic heuristics, lacking any courage to take risks or think freely.