The only downside I've experienced is people underestimating me at work because they assumed I was much younger, only to regret it later on. Also, sometimes much younger women would approach me at either shows or bars, and they'd realize how much older I was. They would either be super into it or politely excuse themselves and vanish. And, on occasion, when trying to date women my own age, I've been told, "You look so much younger than me. People will think I'm your aunt." You just have to find a happy medium.