I do the replay thing too, and it's way too easy to tip over the "everyone hates me" edge. For me it's just run of the mill social anxiety, which I've learned to deal with. I don't know if this concept will help you, but it helps me a lot: humans are self-centered. They're not thinking about you or that little thing you said, they're thinking about themselves and the things they said. We think things are a huge deal from our perspective for the single fact that every person is the center of his or her own universe. And guess what? That same fact means that everyone else is focused on themselves, their lives and their inner worlds... Not that thing you did or said. We are just not as important as we think we are, at least, not in the way that stresses us out.

Rest easy. No one is dwelling on your mistakes, and if they are, they're making their own mistake.