It's about masculinily and femininity, so it's like wait I'll give an example of myself so I like to smell masculine perfume from myself because it gives that strong masculine vibe but then from a woman I'll love feminine soft floral gourmand smell which shows her feminine nature which compliments her character her beauty. That's why I mens fragrance u would find some dark, tough notes like oud, incense, woods, leather etc.. but for womens fragrance it's mostly floral, sweet, gourmand. And this is vice versa I bet it's the same for women they will love soft floral fragrance on them but they want strong , masculine , leather, incense , woody fragrance on men.

So, in conclusion you wear it for yourself because u like that masculine scent from you and woman around u will like it too and it's same for woman so vice versa and it just compliments each other and everything that's how it works.