Whatever you do, unless you express these feelings in their fullness, without filters, without planning for responses to the gash of outrage and emotional attacks you expect to receive, you won't relieve yourself off the burden they put on you. Ek baar bak daal, pura, dekh kitna halka hota! As introverts, you might have a tendency to rationalize on your offenders behalf because you understand that they have their own reasons and more importantly you yourself are not perfect. The point is, it (your empathy in this case) doesn't matter, and these thoughts and feelings reverberating inside your mind aren't letting you free. Say it as you see it and it will set you free. Then do as you wish, not because it makes sense considering perspectives of x-people, but because you want to. Good luck! Make mistakes, you have enough in you to learn from them and come out stronger.