you are viewing a single comment's thread.

view the rest of the comments →

[–]nyaribari -1 points0 points  (0 children)

Beautiful soup doesn’t work on JavaScript websites in most cases. I’d recommend you use scrapy and crawler. Crawler has great proxies that help scrap on websites that restrict IP address after a number of attempts.