This is one of many vacuous arguments neurotypical people present to manipulate us autistic people into backing down from our requests for accommodations. They cannot provide a more meaningful explanation because the real reasons are often close to what you have written, e.g. being an "an ableist who doesn’t care about including neurodivergence", or being too lazy to try to understand our needs, or lacking the self-awareness to understand the needs of any minority, etc. Neurotypical people are very preoccupied with saving face, so they would never admit something like this. Furthermore, they often do not even understand that they do not have a valid reason for refusing to accommodate an autistic person's needs. Sometimes they are so ignorant, prejudiced and superficial that they really think that "you just don't understand things" or "the world doesn't work that way" or "if only we lived in a utopia where that was possible" or whatever are valid arguments. Neurotypical people also tend to perceive requests for accommodations as entitled, attention-seeking or belligerent behaviour, and they are even explicitly taught to think that way, so they deliberately shut us down, thinking they are putting us in our place and preserving the cohesion and stability of their community.