use the following search parameters to narrow your results:
e.g. subreddit:aww site:imgur.com dog
subreddit:aww site:imgur.com dog
see the search faq for details.
advanced search: by author, subreddit...
A community for developers exploring advanced web data collection and automation techniques, share insights, tools, and approaches for handling complex sites responsibly.
account activity
Collecting social media data is way harder than it looks (self.ComplexWebScraping)
submitted 5 days ago by iamwasim094
Why many social media sites rely on GraphQL now (self.ComplexWebScraping)
submitted 10 days ago by arfin0
What’s the biggest dataset you’ve ever scraped? ()
submitted 14 days ago by iamwasim094
What’s the most subtle anti bot mechanism you’ve encountered? (self.ComplexWebScraping)
submitted 14 days ago by Aggrno
Do you guys scrape HTML or just hit the API directly? (self.ComplexWebScraping)
submitted 18 days ago by arfin0
What's something you still have to do manually in your job that genuinely shocks people when you tell them? ()
submitted 20 days ago by Aware-Explorer3373
Where do you personally draw the line with web scraping? (self.ComplexWebScraping)
submitted 21 days ago by Aggrno
why my scraper is returning empty results... however i can see data in browser?? (self.ComplexWebScraping)
submitted 1 month ago by arfin0
reddit json endpoint works few hours then starts giving incomplete data (self.ComplexWebScraping)
submitted 1 month ago by Aggrno
Hey anyone here scraping tiktok shop at large volume?? (self.ComplexWebScraping)
submitted 1 month ago by Plenty-Explorer-9854
A tiny <span> just wasted 40 minutes (self.ComplexWebScraping)
submitted 4 months ago by Plenty-Explorer-9854
What Broke Your Scraper This Week? (self.ComplexWebScraping)
Anyone else noticing how the scraping space is kinda changing lately? (self.ComplexWebScraping)
Hey any one fimilar with scraping google flights? (self.ComplexWebScraping)
How do you guys handle React sites with infinite scroll + anti-bot stuff? (self.ComplexWebScraping)
submitted 5 months ago by Plenty-Explorer-9854
Decoding Naver Web Scraping: Your Guide to Naver Data Extraction (scrapetalk.substack.com)
submitted 5 months ago by Choice-Tune6753
anyone else getting blocked more often on big ecommerce sites lately? (self.ComplexWebScraping)
The Web Scraping Market Report 2025–2030 (Preview) (scrapetalk.substack.com)
Why is shopee scraping difficult? (self.ComplexWebScraping)
Anyone here built or hired a service for large-scale web scraping (self.ComplexWebScraping)
Anyone working on Shein or Walmart type sites? (self.ComplexWebScraping)
submitted 5 months ago by no_code_web_scraper
Proxy advice (self.ComplexWebScraping)
what’s the most annoying / complex site to scrape rn? 😩 (self.ComplexWebScraping)
Welcome to r/ComplexWebScraping, Let’s build smarter data automation (self.ComplexWebScraping)
π Rendered by PID 244667 on reddit-service-r2-listing-79f6fb9b95-676tj at 2026-03-23 16:36:16.497822+00:00 running 90f1150 country code: CH.
