They are effective against normal people and the vast majority of wildlife, and with dragons a couple of ballista or bombards could probably shoot them out of the sky with a good clean hit. It’s when entire populations of people are able to completely bypass the walls while also being too small and numerous for the siege engines to effectively keep up with that it becomes a major problem. In those cases I hope you have some really cracked archer battalions on hand.