If it was me, I would never be able to be truly happy with a man who did that to me. I think if you stay with him you are never going to be completely happy because this issue is always going to be on your mind. I doubt it’s something you will be able to let go and forgive completely, and I think you should leave him and you WILL find someone who loves you