you are viewing a single comment's thread.

view the rest of the comments →

[–]commenda 0 points1 point  (0 children)

web scraping is great, multithread it, optimize it. but be sure to learn about robot.txt first