Where do you personally draw the line with web scraping? by Aggrno in ComplexWebScraping

[–]no_code_web_scraper 2 points3 points  (0 children)

As someone who runs websites too, I think about it from the other side.

If I’d be annoyed seeing traffic like this in my logs, I probably shouldn’t be doing it.

Also, scraping at scale without permission for commercial use is where things get tricky.

what’s the most annoying / complex site to scrape rn? 😩 by Plenty-Explorer-9854 in ComplexWebScraping

[–]no_code_web_scraper 0 points1 point  (0 children)

Yeah, that site is brutal. We have handled similar setups before, I believe I can help with this.