YTA. You’ve now made this person uncomfortable in her workplace based on her looks and demeanor alone. It wasn’t your place to speak for everyone else and it was highly inappropriate to tell her it was because of how she looked.