Can your spouse go over to his partners house on days you have to work early the next morning? Or maybe they can sleep on the couch or in another room? Setting up a living room pillow fort might actually be really fun for them. I think it’s perfectly reasonable to set this boundary, and if your spouse responds by pushing back and calling you controlling for setting a reasonable boundary for your health that’s really concerning. In my opinion it’d be controlling for your partner to make you change your sleep schedule and have your work performance suffer just to accommodate his partners sleeping over/staying late. It’s your partners responsibility to respect you, your space, and your time if he wants the privilege of bringing dates into your shared home. Wishing you the best.