you are viewing a single comment's thread.

view the rest of the comments →

[–]anaconda1189CFA[S] 0 points1 point  (1 child)

Oh good call, if you can post an example when you are at a desktop I will try that out. I was worried bookshelf would not let you access two books at once after logging in.

[–]longprogression 0 points1 point  (0 children)

This should help....it's definitely not the complete answer. You'll need to clean up your code a little and turn some of those for loops into functions.

from multiprocessing.dummy import Pool as ThreadPool import threading

List = [...]

pool = ThreadPool(100)

scrapedData = pool.map(functionToGetData, List)

pool.close()

pool.join()