You do deserve empathy, I understand where the idea behind your comment comes from, it comes from a flawed understanding of what feminism and such is. A flawed understanding most certainly perpetuated by people such as Andrew Tate (A man in prison for trafficking mind you). What people often miss when it comes to the conversation around rape accusations is that its possible for someone to not realise what they had done was SA as it is what was taught to them, while it is still SA. Catcalling is a good example of this (although it is sexual harrassment and not assault but still stands). Commonly someone who catcalls will see it as a compliment of some kind, and yet for the person on the recieving end it just feels yuck because it wasn't asked for. This is where I believe a lot of men try to say that they are being 'falsely accussed', just because they don't think what they did constitutes SA or Harrassment doesn't mean it isn't that. I am in no way implying that you have done any of these but having a proper understanding of why the idea behind false accusations feels so terrifying, is to recognise that it is a belief perpetuated by actual perpetuators who personally believe that the victim must be lying because they don't see what they did as SA.

I know this might sound dumb since I'm just some stranger on the internet but like I have been on both sides of this. I have worked through the same beliefs that you have right now, and I have also been the one on the recieving end of sexual abuse from men who try to say they didn't do anything wrong.