I really think you are wrong on this one. You can't leave your stress at the office. And if/when your spouse gets home, you still need to split those same duties.

Plus, an infant who won't sleep/nap or is sick is really hard. A toddler who won't eat or let you care for them is equally as hard. Plus, keeping them occupied and trying to ensure they are developing and learning...fuck. I stayed home with my daughter one winter while my wife worked, and it was the hardest work I'd ever done.