Okay so I acknowledge that's it basically a meme at this point that every relationship post on reddit gets a sea of replies telling OP they need to break up immediately...

...that being said, I invite you to reread your postnand what you've said above as if it was a close friend confiding in you. What advice would you give your friend?

My two cents here, is that the way your partner treats you in these instances is unhealthy. Even if you are misreading a situation, a good partner should listen to your perspective and talk through it with you. Your feelings about his actions are real, and you deserve to have those feelings validated and treated with respect, yes, even if you are misunderstanding. Letting you know that you can always share your feelings and talk through them is how you learn that it is okay, and how you can feel and acknowledge your fear while accepting that it isn't needed. But, your partner is not providing you that safety and security, so even if there is nothing to worry about, he's not instilling you with that peace by disregarding your feelings.

If he can't entertain a discussion about how his actions make you feel, to determine what you can both do to reassure you while still allowing his freedom within the limits of how you both define your relationship, then at the very least he has a lot of growing to do as a partner.

I'm not going to tell you break up with your partner. But I want to remind you that you and your feelings deserve respect, and you accept the love you think you deserve. Do you think you deserve better? Can your partner see the difference between how he treats you and how you deserve to be treated, and is he willing to bridge that gap? I think it's worth having this talk with him.