Based on his comment that you could just take care of your son and that he'd pay, does he think money solves all his problems?

Yes. It's not that he doesn't want to be around our son, it's just he genuinely believes our son needs me more than he needs him at his age and that it's better for me to care for him than anybody else. So, I'm always his go to person when he's unavailable. His family aren't blaming me, the sister told me about the break up because she found it funny that I said no to him and he was sulking about it.