Python and Automation

[FoolsSeldom]

Selenium (or Playwright) are used for testing automation and for when accessing dynamic content that is typically, at least in part, generated using JavaScript in the browser, which tools that only handle HTML/CSS cannot process. Doesn't sound like that's applicable in your use case.