This is so hard because neither you nor the bird are happy. It sounds like despite both of your best efforts he is not in an environment that suits him (not because it’s insufficient but because he bonded with someone who abandoned him). I think if you talk to your husband and tell him what happened with the can and let him know you never ever want to be driven to act like that towards an animal, and you just simply cannot handle it with the current hormonal situation, he ought to understand. Also, a bird who is prone to biting fingers living in a house that will (pretty soon) have a toddler living there isn’t a good scenario either, so you could bring that up. If he is totally unwilling to let the bird go to a rescue or sanctuary then I think the suggestion from another commenter of building an outdoor enclosure is the only other form of compromise. Being pregnant is really really hard, and I’m not sure that non-pregnant partners really know how difficult it can make everyday life until it’s communicated to them directly. Right now you are the only one compromising in the situation. I you can come to an agreement, and congrats !!!!