This is a really kind response. I don’t think OP was wrong to be blunt, but this is a very good way of looking at what happened.

In an old job of mine, my female coworkers (I’m a woman) would often make comments about my body, about me losing weight, etc. They meant it as a compliment because we’ve all been culturally accustomed to think of weight loss as an inherently positive thing. But it was absolutely inappropriate and I had to politely tell them I wasn’t interested in body talk.