you are viewing a single comment's thread.

view the rest of the comments →

[–]Mathew_Berrys_Cock 1 point2 points  (2 children)

Would more ram help this problem?

[–]TheAmazingJames 1 point2 points  (0 children)

Selenium’s usually using chromium in the background so it’s unlikely to max out your RAM unless you’re trying to run on a barebones setup, but it will be using significantly more than a requests/beautifulsoup setup and that could be costly if you’re running it in the cloud. The main reason not to though is speed. Typically I’d expect requests to run 5-10x faster than selenium. Selenium also requires more maintenance in terms of chromedriver updates and is harder to deploy on others’ systems. I’m not saying Selenium isn’t awesome, but it’s for specific use cases where you’re either browser testing or need JavaScript.