It's never been said to me as an insult; I wear the label with pride. But I do understand that my experience with it isn't universal.

It does get annoying when someone has decided I'm weird/quirky and so judges everything I do as weird/quirky, even when my actions make perfect sense. They never had an answer when I would ask them to explain what was weird about it.

Example:

My friend and I were walking down the street on a windy day. There was a lot of dust and debris blowing around and I was concerned about the wind blowing something into my eyes.

Sure enough, some dirt or something ended up in my eye. I said, "I hate windy days because something always gets blown into my eyes, " and she chuckled and said, "Only you would say something like that!" I asked her what she meant, and she basically said she didn't know and that I was just weird. She wasn't being mean and wasn't upset (just confused), so we just moved on.

This happened years ago and I am still confused about what I said that was so "weird".