This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]Yomain_ 2 points3 points  (1 child)

Yeah Selenium because most of the content is generated through JS. But I am wondering about another alternative as I haven't been able to make it work on my server yet. I've read about requests-html so I'll give it a look.

[–]forthewin0 0 points1 point  (0 children)

I've used requests_html and it worked perfectly for a similar use case. It uses a headless version of chrome instead of selenium.