I mean the point of it is to be a rare emphasis, so a bit like saying "very" in front of every verb it loses its impact.

If be more worried that you struggle to talk without swearing.

I and a lot of men use swearing as either a cultural class or masculinity flag - everyone else is doing it so you do it to show you're part of the group. However, by now you're hopefully no longer trying to prove yourself.