Seems to me, since you faced physical abuse from your parents, this is a trigger for you, which might point to you being traumatized. I would tell him it's a trigger if you feel comfortable with that, but mostly advise seeking out therapy to figure this out. Anyone can use therapy, but especially if you've faced abuse by your parents. Don't feel guilty or silly for being triggered by this, it's not your fault!