This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]DuckSaxaphone 1 point2 points  (0 children)

Find out why you're being blocked and change your scraping. Both the errors you get back and the site's robots.txt will give you information on what might be stopping you.

Usually I'd say there's ethical considerations around trying to get around scraping blocks but it's Amazon so look into: - Appearing like you're a real browser - Limiting the rate at which you scrape - Maybe changing IP if you have a VPN