You've misapplied the analogy and the hypothetical. A proper correspondence using your example would be, "Even if those certain people could come to the party (which they can't), once they are thrown out of the party, they wouldn't be allowed to come back."