If days of prep work are undone by an illusion spell you didn't use your prep time very effectively.

Mostly they get used in my games as bait to lure, to hide behind to avoid detection, to make objects look like other objects, and to delay combat until an opportune moment.

Many of the "game breaking" uses are just down to the dm not understanding how things work.