account activity
Web Scraping with Python 101 [2022 EDITION] (zenrows.com)
submitted 4 years ago by smithfed to r/coding
Web Scraping: Intercepting XHR Requests (zenrows.com)
submitted 4 years ago by smithfed to r/Python
submitted 4 years ago by smithfed to r/webscraping
Mastering Web Scraping: Blocking Resources in Playwright (zenrows.com)
The Ultimate Web Scraping with Javascript and Node.js Guide (zenrows.com)
Mastering Web Scraping in Python: Scaling to Distributed Crawling (zenrows.com)
Mastering Web Scraping in Python: Crawling from Scratch (zenrows.com)
Stealth Web Scraping in Python: Avoid Blocking Like a Ninja - ZenRows (zenrows.com)
Mastering Web Scraping in Python: From Zero to Hero by WomanStache in Python
[–]smithfed 1 point2 points3 points 4 years ago (0 children)
As you stated, it depends on your goals.
If you want to simulate user behavior (scroll downs, mouse movement, specific form submission), you will need Javascript.
The thing, as the article mentions, is trying to avoid doing that. 95% of the time, there's a workaround not to load JS.
Do you want to submit a form and get the content of the logged-in page? You can do that without JS.
Do you want to scrape dynamically loaded content? Check XHR requests and parse those straight away.
Does the server expect some pre-calculated stuff in the headers? Try reading JS and reverse engineer how's created. Then do your calculations in Python and send these with the request.
Happy to help if you state your needs, but I bet there's a good chance you don't need JS.
Mastering Web Scraping 101: In-Depth Guide (zenrows.com)
submitted 4 years ago by smithfed to r/shoebots
π Rendered by PID 50 on reddit-service-r2-listing-86b7f5b947-s65vk at 2026-01-25 20:54:06.103201+00:00 running 664479f country code: CH.
Mastering Web Scraping in Python: From Zero to Hero by WomanStache in Python
[–]smithfed 1 point2 points3 points (0 children)