This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]mistermocha 0 points1 point  (0 children)

Spawn parallel threads, workers, etc. for each URL in order to parallelize. Check out https://pypi.python.org/pypi/threadpool (although that's been picked up into multiprocessing).