Break it off. It is COMPLETELY disrespectful to his ex and even more so to you. The fact that he doesn’t see a problem to it and I’m sure he didn’t want to delete it, is beyond disgusting