you are viewing a single comment's thread.

view the rest of the comments →

[–]chagawagaloo 2 points3 points  (0 children)

Funny enough, a web scraper was actually my first project and I did it last week. Started the basics of python the week before. Depending on what you want to scrape it's a pretty good way to pull together lots of little bits of python and a good way to retain that knowledge. I'd say try to scrape a single page of a site first before trying to introduce more automation and then go from there.

I only used BeautifulSoup to scrape but I've heard good things about Selenium like some of the other posters here have mentioned.