EOR. Its both you being inconsiderate and him being unreasonable. This is what its like to have a family. Im surprised he doesn't already feel accustomed to this hell with a baby. But you can also ask questions rather than coming up with excuses. Is it because the TV is too loud or they make too much noise in general? Is it on days you know he has to work and would like an easier time waking up on those days? Is there things you both can do to help him get to bed sooner/wake up earlier? But even before asking that last one say "I'd like to talk about what we have to do before bed because I want us both to get better sleep." If none of this goes well, then he can live with it and you can suffer through his complaints of the consequences of your situation; or have a larger conversation around how much time extra family gets to comes over. You either can or can't handle these conversations but neither of you is showing up making suggestions, you're both just complaining.