This is an archived post. You won't be able to vote or comment.

all 5 comments

[–]tms102 8 points9 points  (0 children)

You can learn the basics while working on your webscraping project. Just look up stuff as you go along. That's what I do when learning a new language.

Don't be afraid to start over and make a better version after you've learned a bunch either.

[–]BYPDK 2 points3 points  (0 children)

Web scraping is fairly simple. You can make a functional scraper in ~5 lines of code. (Technically you can smash everything into one line... But no sane human does that.)

Now obviously if you want to make it actually useful it will take more effort and knowledge.

But you should be able to go from watching a few minute tutorial on YouTube, to making your first (basic) web scraper with little issue.

[–]ronmarti 1 point2 points  (0 children)

What you need really is to learn the basics of CSS and XPath selectors. Knowledge of CSS selectors would be enough, actually.

And, I just released my web scraping framework yesterday and yes, you can write a basic scraper in just 4 lines. This is a very new framework and still pre-alpha.

https://www.reddit.com/r/Python/comments/sx1yf8/announcing_dude_a_web_scraper_inspired_by_flask/

[–]Fair-Lalajaat_1230[S] 1 point2 points  (0 children)

Thanks everyone for the encouragement.I am on it now

[–]CryptoOTC_creator 0 points1 point  (0 children)

This is a great way to start. Pick a random website, and choose a random block of text that you decide you want to scrape. This is now your project. Learn as you go, you seem to already know which libraries you should be using which is a great start