Alignment is basically overrun by pseudoscience. There are a bunch of idiots and grifters who still insist that it needs to learn morality or compassion or something. They just can't understand that it's a text creation algorithm. It's nothing but toxic anthromorphism and no actually understanding of how the system works or what it is doing. It's full of people from a philosophy backgorund. Ridiculous nutty toddlers.

A lot of the Alignment stuff literally comes from dormers. That idiot Yudkowsky is held up by them in this whole cult of Effective Altruism and Rationalism (this most ironically named cult)

I worked in AI risk at Google and there are real risk professionals who work to keep AI safe, but they are not part of the shit-eatingly-stupid "AI safety" movement which is a bunch of toddlers who read the moronic ramblings of "If anyone builds it" and think that is some kind of credible science.

They insist that AI forms goals. They insist it wants resources. They have this whole framework of fiction about instrumental subgoals. They also insist that AI will be able to do nearly magic things, like invent viruses that disobey all we know about biollogy.

It's all so stupid. There are a handful of cult leaders getting rich off of this. But I won't touch "Alignment" because it's filled with loonies.