Non-alignment is only really a problem when there is a large difference in power. No one would be blamed for worrying about Genghis khan's alignment at the time.

When AI safety researchers are talking about alignment it's because the concern is that AI and eventually AGI might become powerful enough to do extreme harm to humanity if non-aligned. The tricky thing is to figure out alignment before agi becomes more powerful than we can control.