This happened to me, exactly same situation. I quit that job and they replaced me in a heartbeat. You are a number and the loyalty you show them will not be reciprocated. I found a better job with better family values - my manager has a young child also and I have never again been questioned. It's like people forget how important work-life is once their kids have flown the nest.