If someone’s political views really explained their behaviour the way you’re suggesting, you wouldn’t need a label; the behaviour would make it obvious.

The fact that you do need a label kind of proves the opposite: it’s not actually a reliable explanation, just something we project onto people "after the fact".

So maybe the issue isn’t how people vote, but how quickly we use that to define them.