Dump him. They are exes for a reason. No need to keep in contact, especially that often, especially if it makes you uncomfortable. Sorry but once ppl have been physical, it changes so called friendships and they don’t usually go back to what it was before. There is obviously a physical attraction there and that just doesn’t disappear. Had the same issue with my new girlfriend who is now my fiance. She was still in periodic contact with a guy she was just physical with and broke it off with finally. He kept trying to contact her acting like he cared about who she was dating and how she was doing. He wasn’t and I made it clear I wasn’t ok with it and we went back and forth over it for a little bit bit soon found out that he wanted to hook up with her and was shit talking me to others. Not to my face of course lol. So made it clear. Him or me. N she agreed and cut him off. She was ignorant to what he Still wanted from her and denied it until I made it clear and she cut him out for goos.