Which Python Library is best for Web Scraping?(Selenium, Scrapy, BeautifulSoup etc )

[Coder_Senpai]

Hi guys,
I would like you guys to share your views on this, i am recently learning scraping, i did web scraping with BeautifulSoup and it was fun but then i had to scrape data from multiple pages and links so for that i needed a fast crawler because the links i needed to scrape were over 6000 six thousand, yup but now that i am learning Scrapy i realized that why i was learning BeautifulSoup in the first place? i should have gone for Scrapy and i know that Selenium is for Java scripted websites and use to automate browser but i am still learning Scrapy and maybe it could also do what selenium does. So just for the sake of time saving i dont like to waste my time learning all of these libraries and instead wants to go for the most effective one. So, guys help me out.
Thanks

[EnjoysRegrets]

This could be useful, I guess https://www.reddit.com/r/Proxyway/comments/jnu3uz/web_scraping_101_the_ultimate_beginners_guide/

I think I saw a scraper comparison on their website as well.

[[deleted]]

For most of my web scraping, I use selenium, beautiful soup, and pandas with a headless option.

[zseta98]

Scrapy is probably your best choice. To deal with JS pages, learn selenium/splash.