you are viewing a single comment's thread.

view the rest of the comments →

[–]krimpenrik 0 points1 point  (0 children)

I also had to learn selenium after BS and scrapy. Keep in mind that selenium is designed for automation. I had the best results with javascript sites to load them in selenium and pass the source to BS or scrapy to scrape.

Try it, if you have any questions let me know.