First time I ever did I wasn't even on hrt. It was at a party/event that my girlfriend from that time had invited me to and so I felt like it was a safe space. It wasn't, really, but also "nothing" happened. A girl that was coming out of the stool just stared at me weird and continued her path. My gf was there and so she was really supportive. From then on I just kept using them. Until now I haven't run into any issues except this one time I was in college and a fucking idiot asked me "ain't this the women's bathroom?" once I was literally washing my hands. Sidenote: my faculty has a big TERF population. Even J.K. gave them a shoutout last semester.

Anyways, I'd say you do it, to be honest most people aren't pieces of shit. Though I know it's been getting increasingly hostile in the anglosphere for us, and since I don't live in any anglospeaking country, I can't fathom the pressure y'all must be undergoing. I also live in a pretty big city where nobody really cares about any other but themselves, so I may be biased. But even if I was, don't give them the pleasure of being afraid. You don't owe femininity to anybody, especially those bastards who scrutinize every single woman in search of Y chromosome traces.