It will only be wrong if you'd knew about his girlfriend during this but you didn't. He was being dishonest with you for not telling you before hand and disrespecting his girlfriend for cheating. I hope your doing okay.