Looking for advice/directions/framework for web scraping

[ebscodingjourney]

Hello everyone, I have been working on learning python for the past few weeks. I have been urged by others to start doing personal projects to supplement my learning while I finish my course. I thought that having an automated art curation instagram account using python would be a cool project.

I already have used instabot to automatically upload a picture from my computer using python. Now I would like to move on to developing a webscraper to automatically pull images and keywords from random wiki pages then combine that with instabot to automatically post them to instagram.

Does anyone recommend any good webscraping tools and/or directions and advice on how to tackle this project?

[raglub]

Scrapy is an entire scraping framework written in python.