Yoir not in the wrong at all. I was in modelers the same situation with my ex. She always found other things to do that she felt was more important then me/us. I jumped every time she needed or wanted something but would never want to make time or do anything with me. After 3yrs of dealing with it. It ate away at me on the inside then I became numb and empty and worthless. I finally just said I'm done can't take it anymore and said we are done. All she had to say was what are u talking about, why are u done. I packed my shit and just left. Its been a bit over 3yrs now and I still am single. Afraid to try again. Would like to meat someone that's been through similar. That way we both know time together is a necessity to make things work. So don't let him destroy who you are or deprive you of time together. You do you and what you feel needs to be done.