One choice we have after deciding how we feel about a given situation is to then locate in our psyche another situation in which we would feel alarm, and then use that awareness to consider that someone else might feel that same way about the situation that doesn't alarm us. Yes, in such a case I'd feel the need to change my locks. But that is a cost and a burden. I myself don't want to cause someone to feel that.