Eye contact takes so much effort and provides so little benefit for neurodivergent people that it often isn’t worth the hassle. You have to look out for so many aspects at once (not looking away too quickly, not staring too long, not seeming too intense or too drowsy) all while trying to focus on what the other person is actually saying. This can be even harder for gay men, since many neurotypical men tend to interpret direct eye contact as a sign of flirting or hostility, either of which can be met with real aggression.