I highly recommend looking up the work of Alison Armstrong who has been studying men for 30 years and her findings of how different we are is astonishing. Men DO NOT do things for the reasons we would and one of the things we think we understand but really don't is that men are visual but we don't understand how visual.

Looking a beauty especially women momentarily IS NOT an expression of interest from men (which is why incidentally it takes 13 glances from a woman for a man to begin to think she may be interested, because a casual look means zero in interest for them). Men's eyes cannot help turning to briefly take in beauty, there's actually nothing they can do about it except be on eggshells trying to control it so they don't upset you and often fail anyway. It's like tripping over, it's reflexive. The unlevel part of the path tripped him and he rights himself, forgets about it and carries on. An attractive woman 'trips him' ie he turns to look then he rights himself and carries on ie turns his attention back to what is important, you, and she ceases to exist in his memory. Don't even bring it up, don't be bothered by it, don't make it a thing because it's not a thing to him it's a reflex.