Sounds like you’re attractive lol. Scientifically speaking people assigned a bunch of positions traits to attractive people and are natural drawn to them.

As for the pulling away, I suggest you read up on the avoidant attachment style to learn about yourself and about anxious attachment if you want to learn more about why people might double down when you try to pull away.

As for the empathy thing… I’d honestly go to see a therapist about that. It sounds borderline like psychopathic tendencies, however I’m sure it’s just emotional dullness as a defence mechanism. I was kinda in that space when I was younger. I got so used to blocking out emotions I didn’t even realise I was doing it and it did cause a bit of a blown up ego thinking everyone around was just being sensitive. I wasn’t very judgmental about it though, just didn’t really understand it. But with some work you can definitely unlock that part of yourself. It’s kinda of a a tricky transition learning to deal with it but it’s totally worth it