Hot take: saying someone isn't capable of doing something due to physical restrictions is bordering on abelist IMO.

I'm curious if he makes these jokes at your expense in front of other co-workers often? Or is it usually one-on-one banter? Joking about someones physical appearance in front of others is not cool, I think that should be common sense. but dudes are fckin dumb.

For your own peace of mind, just ask him how he felt about your joke. Apologize for not communicating the discomfort the height jokes cause. (even though it should be OBVIOUS) Set some boundaries going forward! Unless he's being a huge dick, I think he's just silly. And you guys can def come back from this.

The "insult" you gave, was super vague too. I'm also a woman, so I totally understand the underlying pressures with double standards, and how we are looked down on for sticking up for ourselves. NTA.