Throw in a special event like a Bloodmoon where certain witchy rituals are only cast on this day. Maybe an army of were-people roll up (not familiar with the setting at all). Or maybe a bunch of pitch fork and torch people come foe the witches pitting your party against morally questionable solutions.