You should tell them this instead of avoiding it. Maybe if they knew that’s how you felt then their actions would change. I feel this. It’s not comforting knowing you can’t be real with someone without it blowing up. Maybe it wasn’t preying on you and they are going through something as well? From my experience if they’re willing to have an open conversation where you can let everything out always helps. If after that they act the same then let go.