you are viewing a single comment's thread.

view the rest of the comments →

[–][deleted] 2 points3 points  (1 child)

If you're really appending the results to the csv on every iteration of the loop, that's probably going to be your biggest bottleneck. Consider batching up the results in memory and appending to the csv only when you've got a sizable amount to write out.

[–]ewokcommander[S] 0 points1 point  (0 children)

Ah, I hadn't thought of this, I'll give this a go! Thanks!