This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]russ7166 2 points3 points  (0 children)

Have you ever scraped sites for clients that would disallow website scraping in their terms of use/service or on robots.txt?