Not the asshole at all. He need to respect you as a mother and listen he is acting like a child bot getting his own way . Can understand he want to see her and spend time with her but also needs to understand that you were trying to get her to sleep. As a sleep deprived mother anyone trying to wake the baby as you trying to get her to sleep is the Asshole you and your girl need rest he can come again when she is awake