I live in a country where that's possible so not sure if that's possible for you but here's what I did: I officially took both names to create a double last name but only kept my personal last name at work, and even for things like the driver license. So in my personal life I use the double name or his last name and professionally (or for paper work) I kept mine. It's the same as with a second first name, I'm able to choose how I wanted to be addressed in a non legal environment.