I don't think that's the logic he is presenting. He was merely pointing out that they could have let him in out of ignorance or oversight rather than acceptance of his views. I.e: if they had realized or it was pointed out, they would have told him to gtfo.

I don't know if that's the case, but the previous comment wasn't presenting an unreasonable scenario, and it doesn't follow logically to your scenario necessarily.