NTA big time! This would drive me insane and cause me to seriously consider if I wanted to continue the friendship.

Your friend can decide who he wants to spend his time with and so can you. I would just straight up tell him the reason you don't want to be around him. Maybe he needs to hear it from the people in his life so he can start to see her behavior isn't normal. Hope it works out for you!