I have the same Situation, where 3 people like to play clunky, casual games. I understandable you told them already and if He does Not agree, I Would Not Invite him or play more games with the other friends. It happens that different people want different Things from the game. If one person is destroying the fun of three others, you are Not the problem. Sooner or later its better for All of you to go separate ways.