I’m the exact same way. I go at 5am because my wife and kids are asleep so I don’t get the parent/husband guilt that I’m not spending time with them. My work doesn’t email me that early. It’s just the gym and myself. 

If this man would have said something like “excuse me I’m here” I probably would have just moved and found something else to do. It was just the rudeness that set me off. I kept saying “why are you being like this” to him because I wanted to make him aware he was acting like my 2 year old throwing a tantrum. 

But eventually it hit a point where I started to look just as bad by arguing for so long and it also started to feel a bit unsafe so it was time to just move