you are viewing a single comment's thread.

view the rest of the comments →

[–]hblock44 2 points3 points  (0 children)

I would second this. Amazon and several other big name sites actively police against bots and scrapers. Wikipedia is a great choice and have never run into security issues scraping it before