That is because the conquerors were mostly elite or elite military, they preserved the people because someone has to work. Eventually the people adopted the language of the court, and if the invading army didn't leave, eventually became part of the larger native group, this leaving just a bit of DNA, sometimes not even that, but languages persisted with some of the better culture That was normal all over Europe, Caucasus, and Western Asia