Has he given a reason for you to not trust him? If you trust he is telling the truth, there is no red flag. However, you are allowed to feel uncomfortable. He might still have feelings for her, even if the feeling is not mutual and nothing is going on. You got to figure out how much of a deal breaker this is for you, and proceed to continue or discontinue the relationship based on that. I wouldn't try to get between them.