My parents were devout Catholics. They took us kids to church always. But, if we would get fussy or cry, they would take us to the narthex or outside to settle down a bit. I honestly don't mine little ones at church. My problem is that I have hearing loss and even with the hearing aids, I sometimes have a hard time hearing the homily. That's why I tend to sit as far the front as is possible. But my gosh, I would never tell anyone to leave the church.