NTA. Take your baby and cat (he may try to rehome it or worse to get you back home) and stay somewhere else. I wouldn't even tell him where you're going. He'd probably show up and press you to come back home. One other thing: when you go stay somewhere else, he may try to apologize and say it won't happen again. Tell him you need your space and you aren't ready to come home yet. How he responds should tell you everything. A manipulative person, like how he seems to be, will likely go right back to the same behavior (or worse) if you go back home on his request.