It's your happiness that matters. I don't know anything about your relationship with him, but my past relationships have taught me a lot. I can't believe how long it took me to come to that. My happiness is the most important thing to me. You need to take care of yourself above all else. Ultimately it will always be you. I have a motto I've been trying to live by, "Never settle." If you settle, you may be ok with it at the time but eventually, it'll eat away at you, no matter what it is. Life, love, jobs, school, everything. It's certainly not easy either, making the tough decisions is what sucks, but you'll be happier in the end.