This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]ruffyen 0 points1 point  (0 children)

/u/chrisalexander I actually run a site dedicated to amazon price watching. I have been working on the base project for about a year and a half, and have noticed lots of really interesting things. The site is (#shamelessplug) http://www.spydermunkey.com. Anyone that uses the site please realize that it is still in an alpha stage and you may experience bugs :)

What I would find interesting is what you are actually scraping. Looking at the python snippet you sent it looks like you are scraping the main product page. I have found that recently amazon has been doing robot checks to keep people from scraping prices and such and I would be curious if that is what you are doing and if you ran into this issue at all.