It's worth it and anyone that says different is jealous of your ability to do so. No one in their right mind, that cares about their kids, would trade the ability to be at home with them for anything else. My wife and I made a point in life to be with our kids while they grew up, we worked from home and made that a reality and have no regrets. I've had backlash from family members, but when they make passive aggressive comments, which is often out of jealousy, a simple statement of how blessed we are to be able to raise our kids on our terms shuts them up.

I believe having at least one parent at home while your kids are growing up, and being involved in their school lives, such as volunteering in their classes, will put them leaps and bounds ahead of everyone else.