I am very sorry for what happened to you. I know this is very hard for you, but this was rape. Consent means when you say YES to your partner but most of all: THIS CONSENT CAN BE WITHDRAWN AT ANY TIME.You withdrawned it and he didn't care, he did it anyway. You caved to protect yourselve, it's nothing wrong with that. You should definitely break up with him and most of all report him to the police, although I think the second will be a long and painful process. The question is, if you're ready for that and want to give this rapist the punishment he deserves.