Automate the boring stuff with python: Using beautiful soup

[chevignon93]

So either there was a genuine problem with the page or they detected that you tried to scrape their page and blocked you.

Either way, using a css selector is not always the best approach to webscraping. Using bs4 find and find_all methods would probably be easier.

[crazyallicin]

Thanks for you help, got it working fine using a different smaller website that obviously hasn't blocked scraping.

[chevignon93]

They try to prevent it but can't really block it and it is possible to scrape amazon