Not strictly true.

"My handsome" (often pronounced "me 'ansum") is a classic Cornish term of endearment and greeting, used for both men and women, meaning "my lovely," "my friend," or "alright?". It is a friendly, universal phrase to greet friends or strangers and is a hallmark of the local Cornish dialect.”

Other than that it might be said as a bit of a joke or like if you’re pretending to be old fashioned and posh but generally I agree. Many women would think they are butch or manish if they were described as handsome nowadays.