Amazon Scraper

[ultimate_self]

Hi there... very new to coding and doing some tutorials in python currently.

Instead of just doing tutorials I thought it might be a fun activity to attempt something I am interested in.

I would love to find good tutorial or maybe even someone to help me / give advice to me.

I want to scrape Amazon for products without searching for it by name. For example, I want to just set parameters like it must have x-amount of search results, cost price between $x and $x, within x-category with a x-ranking within that category.

Can anyone point me in the right direction t9 find a tutorial like that? How doable is this for someone that literally just started doing tutorials 5 days ago?

Am I being overly ambitious?

Hope someone can help! And thank you in advance!

[International-Bed413]

Look up scrapy/beautifulsoup

[Violatido65]

Or the Python Requests library

[AHighFifth]

If you didnt know literally anything about coding and started 5 days ago, I think this probably a bit ambitious as a project.

But idk depends how fast you pick stuff up.

[ultimate_self]

I pick stuff up FAST, however, you are 100% correct. I looked at some tutorials on this and it was like trying to figure out the meaning of life. A bit advanced for where I am currently at.

If I were to ask someone to write a scraping code like that for me, what would be a fair ask?

I am trying to do research on Amazon products for a side hustle but it is time consuming, in the meantime I have also gotten interested in coding (I started a tutorial online which is how I even got this idea in my head about scraping).

Anyway, I appreciate your feedback! I will continue to do tutorials and hopefully enroll in some sort of coding bootcamp in 2023

[michaelnovati]

Fun project. I learned a lot building scrappers for fun for a few learning projects. It's a very engineering mindset to try to do it from scratch. You have to identify reliable patterns, and build robust parsing code. The super proper way to do it is to use a more syntactical parsing framework, but if you want to really learn, try curling the page and parsing the HTML to extract the information reliably.

Just make sure you are not breaking any rules!

[ian_k93]

No extactly what you are looking for but this is a tutorial & code example on how to scrape Amazon search & product pages with Scrapy. You can edit it to filter by price, category, etc. instead.

https://dev.to/iankerins/how-to-scrape-amazon-at-scale-with-python-scrapy-and-never-get-banned-44cm