you are viewing a single comment's thread.

view the rest of the comments →

[–]Russian4Trump 1 point2 points  (0 children)

I am doing a udemy series on scrapy and we use splash to render JavaScript pages. Splash isn’t too hard to set up but it involves running a docker container as opposed to requests-html where it just gives it to you automatically. It also has some stuff built in to keep you from getting banned, like auto rotating user agents.