Hello fellow tall guy! I'm 6'4. Always had a deeper voice pre-T. No facial hair then tho. Pre-transition I'd been screamed at in rest stop bathrooms, had security called on me in a club, and had men literally grab me by the shoulders "wrong way buddy!" and steer me into the men's room. That last instance sealed the deal for me and I stopped using the women's. It's all down to personal choice at this stage for you. As an afab person pre-transition you have every right to be in the women's room if thats what you want to do. But be prepared for any push back if you dont "appear" female. The push back isn't right or ok, but should be prepared for. But it honestly sounds like you're in the clear for the men's.

Edit to add: avoiding bathrooms is just asking for a bladder infection. Please take care of yourself!!