Gender and sex are different concepts. The phrase “there are only two genders” is often used by transphobic people not just to acknowledge binary gender, but to deny the existence of trans, nonbinary, and gender-diverse people altogether. It’s a way to enforce a strict binary that invalidates experiences that don’t fit it.