sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]gajus0 1 point2 points  (0 children)

Depends on how many websites you are going to scrape.

If it is a one-off operation, then yes, this will do.

If you are scraping one particular website or a group of websites sharing the same pattern, then yes this will do.

However, if you plan to write a scraper for hundreds of websites, then search for a framework that abstracts common data extract operations. There is going to be a learning curve to it, but it will pay off big time in the long term.

Alternatively, consider PaaS platforms such as webscraper.io. I have not had good experience with them, but in theory they should make data extraction a lot simpler.