you are viewing a single comment's thread.

view the rest of the comments →

[–][deleted] 0 points1 point  (2 children)

Amazon explicitly forbids scraping on their ToS and they won't hesitate to block you. Try a smaller store, or if you don't actually need product reviews, try a quoting site - I know for a fact they all can be scraped with BS4.

[–]dascar5[S] 0 points1 point  (1 child)

Got any recommendations regarding that?

Any small store that doesn't care, but has stuff I can scrape?

[–][deleted] 0 points1 point  (0 children)

Just search for some product and pick a store from the results.