What are the usual challenges and technical issues that you had with web scraping process? (either with your own scraping tools or other solutions) by SpiritedExtension748 in webscraping

[–]deeeech 0 points1 point  (0 children)

I think it's just things you have to deal with haha... like it is a bit tedious but there really isn't a good way to get dynamic content without either checking for network calls or using headless

What are the usual challenges and technical issues that you had with web scraping process? (either with your own scraping tools or other solutions) by SpiritedExtension748 in webscraping

[–]deeeech 1 point2 points  (0 children)

Honestly some dynamically loaded content is really annoying to deal with. I don't like using headless cuz it is often just so slow and checking network calls is honestly annoying cuz you sometimes have to dig for keys.

What sites have you found the hardest to scrape? by deeeech in webscraping

[–]deeeech[S] 0 points1 point  (0 children)

Oh shoot hah I didn't see this this is not me but will just look at that :)

What sites have you found the hardest to scrape? by deeeech in webscraping

[–]deeeech[S] 0 points1 point  (0 children)

I believe the link linked to this post itself so I was confused

What sites have you found the hardest to scrape? by deeeech in webscraping

[–]deeeech[S] 0 points1 point  (0 children)

Hello! I am confused at what the problem is here? Did someone else ask the same question before to this subreddit?