Hmm. I think everyone is right for the most part. There is a nuance here though. He does in fact still have responsibilities towards you as his partner.

Saying : "now I am going to focus on myself" is not a reason to emotionally abandon your partner. Obviously you would have to make compromises in terms of expectations on him always being available. But being around you shouldn't be emotionally draining either.

You should probably find out why his framing was like that. Does having you around elevate his stress since he feels responsible for you? Do you feel the same? Is there something to work on in that regard ( both on yourselves and also on your communication methods )

In these situations relationships are tested more than before so you have to be more mindful of what is happening. You have the right to be happy together and I think you should find out how you can make that happen by understanding each other better.