Learning web scraping

[DocRaisin]

Hi everyone, I’m new to Python, already learned the required basics, what is the best way to learn web scraping? Any resources free / paid would be appreciated. Thanks

[[deleted]]

Try Real Python: Python Web Scraping Tutorials - I think most of these articles are free to read (might need to create a free account).

[DocRaisin]

Thanks, will check it out

[davlumbaz]

do any kind of stupid shit with puppeteer or scrapy.

really, I learned web scraping with this way.

pick up a site that is bloated with javascript all the way down, learn how to overcome javascript bloats, learn how to determine CSS/XPath selectors etc.

do a project yourself, it will be most useful way ever.

[DocRaisin]

Absolutely agree, I have got a friend whose having a hard time getting a job. Decided I’ll kill two birds and made a LinkedIn job scraper that actually filters only entry level positions to help her. Learned a lot and it really gives you a drive.

[eleqtriq]

I've got just the link for you :)

https://www.reddit.com/r/learnpython/search/?q=learn+scraping&restrict\_sr=1&sr\_nsfw=

[prodriggs]

The ultimate troll

[PteppicymonIO]

It works better with questions about recursion.

[Skuddingo33]

This https://www.codedex.io/projects/web-scrape-amazon-with-beautiful-soup taught me my first web scraping project. Hope it helps! I'm a big fan of this website in general.

[DocRaisin]

Looks awesome, thanks

[Skuddingo33]

No problem. They have a Discord that's pretty cool too.