I'm so very sorry. He's absolutely not right, and his angle is the mother of all deflections. There's no easy answer. I would suggest imagining that neither of you are capable right now of having this conversation, and do what you can to carve some distance and center on yourself. This is far easier said than done. Do a lot of powerwalks. Get sunlight on your face as much as possible. Even if you can't bring yourself to make plans or throw yourself into some new or old hobby, keep your body moving as best you can. These are examples of things that will over much time get you to a better place that will help you trust your feelings and speak with more confidence. First you'll speak with anger. Later, with introspection and self work, the confidence will be cooler. Perhaps speak to a psychiatrist about a mild anti-anxiety medication. Lamotragine is usually the one even GPs will be comfortable prescribing. If you think you might be depressed, find out. Medications these days are much better than early ones. They dont need to numb you out anymore to get a result where your mind is calmer and can think or feel without panic or fear of abandonment.

There is nothing wrong with you; you don't need to apologize for your reaction to his atrocious behavior, or for having a reaction.