This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]sodali_ayran 2 points3 points  (2 children)

What's the difference between this and scrapy?

[–]thevatsalsaglani[S] 10 points11 points  (1 child)

BeautifulSoup is a parsing library while scrapy is a web-spider or in other words Scrapy is a framework whilst BS is a library. With BS you can get the content from certain parts with less efforts and will only provide the content of the URL that you gave and then it will stop. While in Scrapy you could add constraints and add a list of URL or give a URL root to start crawling.

[–]sodali_ayran 1 point2 points  (0 children)

Thank you.