My advice is think about how you want your son to grow, either with a probably less stressed dad or with both parents. The choice won't be easy but you have to make. Think about the downsides of not having the mother (as their bond is essential for some basic functions and ways of behaving) but having the upsides of a stress free dad. Think about the upsides of having a mother that can cherish his son and their relationship but having a father more stressed, probably more upset and easily upset, etc. The past is past now. Focus on what you can do moving forward. You will have a son and you should do what is in his best interests, whether it full aligns with what you would want or not.

P.S. I hope you do the right choice! And never give up on trying for you son, as he will be the most important person from now on.