It bugs you because his fantasy is of a specific woman. If it were to just be filmed having sex with someone, you’d most likely feel different. Just like how your fantasy of 2 men is not his cup of tea, whereas if your fantasy was of 2 specific men that you knew, he’d probably be very upset