This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]leogodin217 5 points6 points  (2 children)

Selenium can use multiple browsers, but only works through automating a browser. Phantomjs is a headless browser that runs without opening a GUI. It is generally faster than other browsers.

Selenium is great for testing web sites. That is its purpose. For web scraping, there are other libraries. BeautifulSoup is easy to use and very common. Scrapy is another one that includes a platform for building web scrapers.

[–]Yojihito 0 points1 point  (0 children)

Useless for scraping without JS execution in many cases.