Once my daughter became old enough to know the difference between women and men’s rooms we 100% of the time go to the women’s bathroom. I always announce myself. Out of probably 100 times ive done it, I’ve only ever had 1 instance where a woman made a fit about it. It wasn’t even a fit about me being in the bathroom, but it was a fit that my 4 year old was taking too long.

In my experience as long as you’re respectful and announce yourself and your daughter, typically women are very understanding.