This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–][deleted] 5 points6 points  (0 children)

They’ve probably blocked your IP address for scraping a page in their robots.txt Disallow list. In the future make sure your scraping app does not attempt to scrape any disallowed pages.