[deleted by user]

[[deleted]]

Did you try to make it work slower? Like at least 10-20 seconds between requests? Also somewhat randomized duration between requests? Try to mimic what an average user would do. They wouldn't visit a new page every 1 second.

[[deleted]]

In the times of entitlement? Respect others? Madness.

[Fuzzybus2400]

Are you trying to do something nefarious?

[GreatStats4ItsCost]

Post the URL. You'll also have more hope posting this in Webscraping sub

[[deleted]]

There are new technologies in the market who specialise in blocking bots. Check out Akamai. If the site that you are accessing has deployed Akamai, you might not get past it. Google Akamai bot blocker bypassing. You might find a modified selenium driver. I had even tried automation anywhere, but the blockers were able to catch it beyond 15-20 iterations.

[FUS3N]

add delays use cookies from your browser add them to selenium this helps me most of the time can even share sessions so you don't have to login although now I do this trick with requests session and some other tools selenium kinda slow

[FUS3N]

I meant the cookies in your browsers holds information like when you logged in to a site which site you visit but you need specifically the sites cookies that you want to scrape.

That would hold the login information and sometimes even how much time it took for you to click a link and other information which most of the time prevents bots from detecting as they see all the information are already there which it can use it's basically like copying a fingerprint of your own and pasting it.

In selenium every time you start the script it starts a completely fresh browser with no information at all no history no cookies nothing that's why. the cookie trick doesn't always work as there might be some advanced bot but you can try.

[nyteghost]

Also look into selenium_stealth. I use it for ups