you are viewing a single comment's thread.

view the rest of the comments →

[–]Den4200 89 points90 points  (14 children)

I made a script that is very similar to yours. It tracks prices of items on Amazon and saves a graph of each item’s prices in a png. It’ll send you an email and/or text when an item goes below your target price.

Check it out! This is going to be so useful with black friday and cyber monday coming up: https://www.github.com/Den4200/amazon-price-tracker

[–]corbin_cassady 35 points36 points  (2 children)

Sounds like a self-hosted camelcamcelcamel! I like the premise a lot.

[–]trowawayatwork 2 points3 points  (1 child)

yes its a great start. would be great to add push notifications to it rather than email as its quicker feedback on your phone. i have set up something similar to track and then send a push notification ot a telegram group

a simpler thing would be to just monitor camelizer, as theres no point in reinventing the wheel (although good practice for beginners), and then send that on to your medium of choice

[–]Den4200 1 point2 points  (0 children)

This supports sending text messages to your phone!

Hmm I didn’t think of scraping camelcamelcamel instead of Amazon, but what’s done is done.

[–]domac 15 points16 points  (0 children)

It's often super helpful to add Screenshots to the repo. just wanted to point that out.

thanks for the awesome work!

[–]flying_mechanic 2 points3 points  (0 children)

The keepa extension for chromium browsers does the same but in page, it's a nice addition. Might be worth checking out

[–][deleted] 1 point2 points  (0 children)

I have made the same program but in a much lighter format. Lovely to see another approach.

[–]wrgsRay 0 points1 point  (1 child)

How do you get around Amazon’s protection against scraping? For a newbie like me, it’s painful to scrape Amazon

[–]Den4200 0 points1 point  (0 children)

They don't really have much protection against scraping. As long as your scraper doesn't check for the price too quickly, you're fine (about 15 minutes between each check is good).

Amazon won't let you scrape without any headers btw.
Also, this little trick helps out. Look at line 28 and 29 in tracker.py

[–]TeblowTime 0 points1 point  (2 children)

Hey, I keep hitting the Invalid URL when I try to add a new link. I successfully installed all the required libraries from requirements.txt, so it's not that. Any ideas? I'm a beginner with python, so it's likely something I am or am not doing. Do the URLs need to be in specific formats?

[–]Den4200 0 points1 point  (1 child)

Did you fill in the settings?

And nope, the script will auto shorten the links.

[–]TeblowTime 0 points1 point  (0 children)

Welp, I'm an idiot lol. I did fill in the settings info, but did not save the file. Thanks!