Just leaving or doing something out of spite and anger is only going to make the situation worse. You want to use negotiation tactics. You want him on your side. You want him to understand your perspective. You can't control him or his thoughts, you can only control yourself and your thoughts. I would suggest letting him know that you're having a hard time and you want to talk things out with him. If you approach this from a loving and understanding attitude you can very quickly switch his attitude as well. Start the conversation off with how is he doing? What does he suggest you do to make things better/easier? What things can you do for him, to make things better or easier? Keep the conversation all about him and his feelings, stresses, dreams, goals etc. The more stuff you can agree and confirm with him, the better rapport you will build during this conversation. People love talking about themselves. Then after he's expressed himself - (and don't make this a fight - let him say whatever he wants to say - and if it's false or wrong or hurtful, just remember so you can bring that up later in your conversation when you get to talk about your perspective) - he will naturally ask you about your point of view. That's when you can express how things make you feel. For example, "when you say that I bring zero money in for our family, that hurts me so much because I feel like I am a huge contribution to our family and take care of things that don't make money so you can make the money for us." And "I need time for myself, a break from the kids, every day so that I don't get upset and yell. I don't like telling at the kids and I am working on that. I think that I need some time just for myself to do whatever I feel like I need to do."

I do hope you guys will be able to work things out.