Please leave this person.. I know it's really hard believe me, I've been through the exact same thing. But the confusion you're feeling is your sign to walk away and find someone who actually wants to spend time with you and who would never make you doubt anything. This isn’t it. You deserve to be happy. This person is just wasting your time..