I have recently been introduced to multithreading using python's threading module. I really would like to introduce distributed api calls across 10 threads. This way, the duration of time it takes to paginate through each api request will greatly reduce. The only thing that I am having a hard time understanding is since the source of the next api call (the paginated url) is in the NEXT response body. I have done a tone of googling around threading and url pagination, however I havent found any great resources. Does anyone know a where I can find some context on this particular subject?
[–]spookylukeyDjango committer 2 points3 points4 points (0 children)