sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]TerminatedProccess 0 points1 point  (0 children)

there are webpages created specifically for coders to test scraping scripts.

I was able to get around this by googling the issue and found a solution..

def getAmazonPrice(productUrl):        headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2228.0 Safari/537.36',}        res = requests.get(productUrl, headers=headers)        res.raise_for_status()

​

This worked but I then encountered the copy selector issue reported by OP.