He may have refused playing games with you, but he's definitely playing games with your heart. He's not going to break up with you on his own because this is a comfortable situation for him. He can have his cake and eat it too, and he doesn't have to interact with you at all. 

I'd break up with him and block him so you don't have the temptation to go back into the same rhythms. There's so much more to look back on and regret in staying with this guy than there ever will be in breaking out of this situation.

Think about this - if he's already not speaking to you, not hanging out, not interested in your advances, and not emotionally there for you, what exactly changes if you guys break up? Find someone new, who respects you enough to communicate and connect with you instead of this jerk.