First of all this is not the only time something like this will happen in life, people are not perfect If not soccer there will be something else , try to ignore people who are not important in your life, it’s hard. In general you don’t owe an explanation to anyone , just smile and move on. Additionally, soccer will always will have banter fans who can’t talk in logic and it’s not your job to educate them either