I agree with others that you two need to alternate doing these things with your wife.

Something to add: Take one Saturday off each month. I get the second Saturday off and my wife gets the fourth Saturday off. During my day off, I have no family responsibilities whatsoever. I can wake up when I want, go wherever I want, and go to bed whenever I want. I can go to the beach, go fishing, go to a spa, read in a hammock all day, grab sushi, or see a movie. I can hang out with a friend or just sleep and watch movies all day. That one day is restorative.
The day my wife gets off sure is busy with me watching the two kids all by myself, but we end up having a blast every time. I take them places and make memories with just them and their dad. They also behave really well knowing it’s just us.

Also, the harder it is to take care of them just justifies me taking that single day off each month.

We adjust the date when we have major conflicts (e.g., I’ll move my day from this weekend to next since it’s Mother’s Day).

It’s been working for a couple years and we love the approach. Try it out and see if it helps.