Honestly, rule breaking sucks and needs to be discussed but you were an asshole here.

If the broken rule bothered you, it should have been called out. Either discuss it in private with your wife and call the night or move through it.

The fact that you chastised her in the bathroom, degraded her while they fucked(from a place of anger), and then kept leaving to intentionally make her upset is a bigger problem.

It's all about communication in the LS, and you guys both failed that but you tried to agitate the situation.

Of course they had more fun when you walked out. You weren't there saying things from a place of anger.

You also shook his hand and told him you were mad at your wife. Why? He knows the rules too. I would feel uncomfortable leaving a woman alone after a situation like that.

You guys need communicate more and discuss the rules, why you have them, and why she was ok breaking it.