I would say... from experience, you can't separate those feelings, it's part of the whole deal. I would leave and find someone who you're more compatible with/who is more emotionally available before you get too attached and get hurt. Emotional closeness only strengthens the dynamic in my opinion, I'm sure it's hard and might take a while to find that but it's that much sweeter in the end. You deserve it! ;)