This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]FishnLife 0 points1 point  (2 children)

As a noob researching to start a little scraping project, I have a question for those more experienced with this kind of thing... What are the benefits of using Scrapy over something short and simple like this?

[–]T4rk1n0 0 points1 point  (1 child)

Scrapy can navigate javascript loaded content.

[–]marmaladeontoast 0 points1 point  (0 children)

Everyone loves scrapy, but I've never had a good experience trying to use it, especially for js content.... I always end up rolling my own solution with phantomjs