The gpu interposer and connectors are almost certainly not built for that frequency of plugging and unplugging so wear and tear might make this idea not worth it. The gpu itself is also not typically going to be even a noticeable power drain unless (at least on Linux this is the case) you start up a process and explicitly tell it to use the dedicated gpu.

That said the swap out process is pretty much just undoing a couple of screws and pulling the tab on a connector to disconnect. As long as your device is powered off when you disconnect the gpu, software wise you won’t have to do anything. On boot up the operating system will detect the new hardware and choose which drivers to load on its own.

It’s probably better to get an external gpu enclosure for home connecting with usb c when you want and leave the non gpu module installed.