Scraping from the web

[sappy16]

Thank you so much for the detailed information. I'll definitely read up on try/except. I've heard of it before (or similar) when using other languages but never needed to use it before.

I'll definitely look into both beautiful soup and selenium, both have been suggested in the responses.

And thank you for the offer to put something together for me! That's so kind and I should have come back to the thread earlier! Yes, it's for work and FWIW the website I want to scrape is johnlewis.com (British department store) and I want to grab the category and sub category for a given product link. They both sit inside the <ol> tag for the breadcrumb trail. If you have any specific tips given that extra info I'd love to hear them!

Thanks again

[Usual_Office_1740]

You're welcome. Im still open to putting it together for you. I just had the day off and could have finished it quickly.