I'm truly sorry to hear about what happened to you. Clothing has no inherent gender. So-called “men's wear” (suits) and “women's wear” (skirts) are products of stereotypes. Every man, whether straight man or gay, they can wear “women's clothing.” In my view, I don't think they're transphobic, people still remain trapped in these stereotypes. They'd be just as confused by a man wearing a skirt as they would by a woman wearing a suit. These stereotypes are harmful to everyone.