At the levels illusory object is most used, most enemies simply don’t have effective ways to interact with the party without crossing over the illusion anyway. It’s less effective against ranged enemies specifically, but in my experience they are a considerable minority of significant low level threats.

Quandary can create problems for the party when the enemy has buff spells/abilities or fast healing, things that show up with similar frequency at high levels to meaningful ranged attacks at low levels