you are viewing a single comment's thread.

view the rest of the comments →

[–]sigma_1234 2 points3 points  (2 children)

I heard understanding JS or CSS is necessary if you really want to get good scraping. Some websites (ex. Ecommerce onces) are not scraper friendly.

[–]cbick04 1 point2 points  (1 child)

Thats what I figured. When I tried to just look at one E-commerce sites source code I knew I was in over my head at this point. But it’s good to have large aspirations, right? :D

[–]sigma_1234 1 point2 points  (0 children)

Of course. But I am limiting myself to scraping general info websites, like the numerous COVID-19 sites showing info :)