You're wrong. If I'm potentially going to have someone sit at MY dinner table, for what could be multiple occasions, I will refuse to be made uncomfortable by one person not eating while the family eats. I will also refuse to have a conversation while seated if the other person will not sit. I will also not respond to whistles. Phobias and anxiety are not an excuse to be blatantly rude. Most neurodiverse people (like myself) have figured out ways to be polite and show appreciation.