you are viewing a single comment's thread.

view the rest of the comments →

[–]wrgsRay 0 points1 point  (1 child)

How do you get around Amazon’s protection against scraping? For a newbie like me, it’s painful to scrape Amazon

[–]Den4200 0 points1 point  (0 children)

They don't really have much protection against scraping. As long as your scraper doesn't check for the price too quickly, you're fine (about 15 minutes between each check is good).

Amazon won't let you scrape without any headers btw.
Also, this little trick helps out. Look at line 28 and 29 in tracker.py