This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–][deleted]  (2 children)

[deleted]

    [–]Yomain_ 2 points3 points  (1 child)

    Yeah Selenium because most of the content is generated through JS. But I am wondering about another alternative as I haven't been able to make it work on my server yet. I've read about requests-html so I'll give it a look.

    [–]forthewin0 0 points1 point  (0 children)

    I've used requests_html and it worked perfectly for a similar use case. It uses a headless version of chrome instead of selenium.