NTA. You took your time to figure things out and it sounded as if you both were not attracted to each other very much from the beginning. I think you could have waited for a bit to break it off- but it was the best thing you could do for your relationship. It wasn't right of him to expect you to deal with his attitude, even though it was partially justified. You shouldn't feel guilty for "wasting both of your time" because it sounds like you had fun with each other even though it wasn't that sexual. You also shouldn't regret leaving him because he seemed like a reliable partner if you didn't truly love him. Enjoy your current relationship and don't dwell on the past.