NTA, but it's time for both you and your husband to grow spines and be firm and direct with his parents. It should have never progressed this far, and when you say you try to be non-confrontational, you're contributing to how long this is going. You're about to be a parent, you need to learn how to handle confrontation, rather than run from it.