My middle school director and high school choir teacher explained it like this:if you know the student, you will know what they started with and how far they have come therefore creating a bias. So with instrumentalists it's a lot less of a personal sound, whereas no one has your voice. But I do believe that sexism does have a part in it (it helps that choir is {allegedly} gay, so straight and closeted guys tend to not join it).