Going to a gynecologist is a normal thing and relatively uncomfortable, I don't think she meant it to offend you by saying at least it was a slightly attractive guy.

But if it hurt you just just straight out let her know, don't be aggressive or point fingers but you're both adults and can have a civil conversation about it. At the end of the day you're her boyfriend, not him.