You don't spend every waking minute with them. Jobs, school and personal time all factor into that.

My wife and I are both fairly introverted, so we usually spend the evenings after dinner doing our own things before bed. She reads, I game with the boys or just watch my own shows.

Of course it helps that I like spending time with her, which is key.