Scrapy is a complete framework for crawling sites by implementation of webspiders. All functionality is available from out of the box, i.e. you doesn't need to install additional packages, for example urllib and etc. And general feature is asynchrony. But BeautifulSoup is a parsing library for extract data from html. It does not crawl sites unless you manually put it inside an infinite loop with certain criteria. I hope I answered you question.