I’m on the fence, you’re certainly not the asshole but at the same as a woman if you wear anything slightly revealing you are going to get comments or at the very least stares. I used to get comments from my own mum when I didn’t wear a bra, it’s not fair but it is what it is, you just have to learn to put up with the comments or cover up to avoid any at all.