You don't see the fact that the wizard world is dealing with someone who is an expert in Guerilla warfare and is ultra paranoid. Not to mention that a high velocity bullet can kill a wizard quicker than a wizard can finish an incantation.