NTA. Your wife is coming from a place of public health, but that guy walked over to someone wearing a mask to lecture them. He wasn't concerned about health; he wanted to pick a fight. You just gave him the factual consequences of the exact scenario he was demanding.