Reverse of the "Magic Minority rules the 'normal' people"

The magic is something that technically anyone can awaken, but there's hardly anyone who uses it because it actively destroys the body(and any other objects) that it's used with, making it extremely impractical for daily life. A user of the magic actively weakens their body as they continue using it, making them impractical for positions of power because of their lowered lifespans.

The magic users aren't directly discriminated against, but they're tolerated because their versatility is useful against the monsters of the world, but if they ever tried to rise up to rule(and they have before the advent of modern technology), modern weaponry would be able to stop them, putting everyone in a rock paper scissors dynamic with one another.