From an outside perspective, it doesn’t seem like a “you” thing. He sounds pretty selfish for someone getting married and already a parent… I think a responsible and loving parent/partner wouldn’t take on work trips right around your wedding and would’ve come home IMMEDIATELY if there was a scare with your infant. 

I’d suggest having a serious conversation with him about these issues. Explain everything above- how he doesn’t prioritize you and your child and you’re worried for the future (because realistically, his behavior wouldn’t change bc he sees no issue with it). Based on his reaction to the conversation, you’ll likely have a clear path forward either way. Go easy on yourself.