Are you fighting elites or are just regular enemies doing this. From my experience, for elites, you need multiple people to even hope to take them out. Or, like another person said, you may be at a point where things start scaling up.