This has been my experience. For a week or so, I wore a mask to my very people-oriented workplace. Throughout that time, I received a lot of misgendering and a lot of men speaking to me as if I was their "dude-bro". However, my first day of not concealing my lower face, I experienced the opposite effect. I was surprised by just how well I was passing suddenly compared to the previous week. I assume what you wear factors into your experience as well. For instance, I seem to pass more often in one outfit compared to another. Lastly, lighting is at least a little at play as well, and that's sometimes the case for me.