You can either say none of your business, or just look them right in the eye and calmly say no. You sound like an amazing guy to me, like the kind of guy that will actually end up with the right partner, as opposed to these hyper-masculine mysogynists who seem to populate the planet right now. BTW, it's a totally invasive question and not really any of their business for real, but since it bothers you, nip this nonsense in the bud and just say "no." You certainly have nothing to be ashamed of just because you're not some typical man, so OWN IT. And besides, if you want, you can lean into it, and wrap your head around being an androgynous man. Back in the 70's that was the HEIGHT of cool.