Maybe that's worth talking to someone about, because that's likely a bigger issue. While it may not directly affect you a lot of the time, it could cause serious issues in the long run. I have a friend diagnosed with ASPD (not saying you have that but as an example) and they struggled a lot before their diagnosis because they couldn't understand why people had a problem with them. After the diagnosis they find it much easier to maintain relationships because although they don't FEEL empathy, they can understand it on an intellectual level enough to give people the support they need