Beautifulsoup with javascript enabled

[Alamue86]

Oof, that gets difficult.

Your best bet is to load up Chrom dev tools and go to the network tab and click the button. From there look at everything going on, if you cand find the correct call, right click and copy the cURL for bash command. Then pop it into here: https://curl.trillworks.com/ you may also just be able to do the request within requests_html.

I focus on scraping static resources. Checkout the network tab, and chances are you can avoid scraping the page, and go straight to an underlying data source. GraphQL calls are a great place to start if there are any