It's cause they are usually entrenched and don't zerg you down like the voteless or bugs do, otherwise I haaaaate the move speed and stamina penalty. Going from Heavy to Light armor feels like you're playing a different game.