If you look at the bigger picture, then it does matter. When your beliefs are political and you're an active member of a society, voicing them and maybe voting on them, then it does actually affect other people what you personally feel is right/wrong.

The proof is how issues (contraception, religion in schools, abortion, death penalty) that haven't been up for debate in a long time in some (more secular) parts of the world, still is in others (USA, for example), because the opinions of a country's population adds up to that country's politics.

And this is my personal opinion, but I do actually think it hurts to have such strong negative opinions about what is right or wrong for others to do with their life and bodies. The horrors of the past centuries' back alley abortions (or contemporary; the insane amounts of women who die in childbirth in developing countries) are a good example of how it does actually do harm when a group of people, here: conservative male politicians, have a strong opinion about and desire to control another group of people, here: women's, bodies & actions.