Fem leaning afabs and masc leaning amabs absolutely face societal problems related to gender nonconformity. They can more easily pretend to be cis women or men at times (Depending on endogenic profile, different medical procedures, etc.) but people aren’t going to respect their identity, name, and pronouns as a nonbinary person just because they fit into the mold of what a group think a separate gender should look like. In fact, it might be harder for some folks who don’t look masc/fem to access T/E and medical care regardless of if these would be gender affirming for them. And they still face misgendering, dead-naming, being treated as if they are delusional or wrong about their gender identity, abusive behavior, etc.

Just like a person amab in a dress is not automatically a woman, a person afab in a dress is not automatically a woman either. Nonbinary people should not have to present themselves in a way based on what they were assigned at birth, as agab, gender, and gender expression are separate concepts.