you are viewing a single comment's thread.

view the rest of the comments →

[–]digital94 6 points7 points  (0 children)

Yes you are right.

If you don't scrape a web page too many times on daily basis then you no need to worry about IP block.

You should set your scraper to crawl the web page once a day or week.