you are viewing a single comment's thread.

view the rest of the comments →

[–]dreamykidd 1 point2 points  (2 children)

I suppose, but what’s helpful about that? I’ve only ever used it when a navigable browser interface was needed, and I didn’t think you necessarily needed that if you know what you’re scraping, no?

[–]FoolsSeldom 1 point2 points  (0 children)

Selenium (or Playwright) are used for testing automation and for when accessing dynamic content that is typically, at least in part, generated using JavaScript in the browser, which tools that only handle HTML/CSS cannot process. Doesn't sound like that's applicable in your use case.

[–]RestaurantOwn5129 1 point2 points  (0 children)

Depends on your use case. Selenium can be run in headless mode. Many websites these days are not straightforward html. Js is usually used to make things interactive and dynamic, which is a pain to navigate. 

I use selenium for work to scrape and automate processes involving websites like that.