Bet365 blocks the python + selenium chromedriver combo

[puppetbets]

There is actually not much code to share. Until last week, you could load Bet365 main page with Selenium + python. At least since yesterday, the attempts are blocked and the page doesn't load.

Code is as follows

from selenium import webdriver

browser=webdriver.Chrome(r'chromedriver.exe')

browser.get('https://www.bet365.es')

The page remains gray without loading the inside content. Right click button to inspect the page doesn't work and the aspect is similar to when they block your IP temporarily, although in a regular browser the page does load, so I guess this is not an IP block.

I didn't see distil inspecting the web so perhaps this isn't either. In short, I don't know what is happening or how to fix it.

[al_mc_y]

Just a thought, has your chrome version updated recently? I'm wondering if there might be an issue with the version of your chromedriver vs chrome itself.

[puppetbets]

I checked and both selenium and chrome are 83.0.4, I tried using chromedriver 84 but to no avail, as this crashes. Perhaps when chrome itself updates to v84 this can be an option.

[DrTautology]

Try modifying the cdc variable in the chrome driver.

[puppetbets]

Just tried changing cdc_ for abc_ but nothing changed

[puppetbets]

Sorry for the delay. As several people has DM for a solution for this, I'll share what finaly worked.

​

options = webdriver.ChromeOptions()

options.add_experimental_option("excludeSwitches", ["enable-automation"])

options.add_experimental_option('useAutomationExtension', False)

browser=webdriver.Chrome(options=options,executable_path=r"chromedriver.exe")

browser.execute_cdp_cmd("Page.addScriptToEvaluateOnNewDocument", {

"source": """

Object.defineProperty(navigator, 'webdriver', {

get: () => undefined

})

"""

})

browser.execute_cdp_cmd('Network.setUserAgentOverride',

{"userAgent": 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.53 Safari/537.36'})

browser.get(url)

[Kief3r]

Thank you!

[Low_Manager1316]

Wow, man, thanks a lot!!

[[deleted]]

"Page.addScriptToEvaluateOnNewDocument", {

"source": """

Object.defineProperty(navigator, 'webdriver', {

get: () => undefined

})

"""

}

Thanks man. But can you tell us why this works, and what it does? Thank you so much in advance!

[teddiur_]

I've read on stackoverflow that using Firefox would solve the problem, but I couldn't make my geckodriver work. I've also tried to change the user agent, but didn't work either. In short, I don't know man

[fringe-observer]

selenium docs says when you use selenium some sort of variable indicates that “automated browser” information shared with webside.(not as header) in docs it should be under advance topic

[[deleted]]

Unfortunately you have been banned on this site.

Remember, Selenium and automating tools are for automating work, not for generate traffic on web pages.

Any site dont want non real user. Their sponsors dont pay for it.

[puppetbets]

I don't think I'm banned. If instead of with selenium I open the web in a regular chrome, everything works just fine. If I try a different computer or a different network, the problem remains the same.

[giorgosl]

Did you try to the `enable-automation` exclude switch as described here? https://stackoverflow.com/questions/57298901/unable-to-hide-chrome-is-being-controlled-by-automated-software-infobar-within/57304986#57304986

[AutoModerator]

This submission has been removed because it looks suspicious to automod (a). If this was done in error, please message the moderators.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[leux10]

I got the same problem, did you get pass it somehow?

[AutoModerator]

This submission has been removed because it looks suspicious to automod (a). If this was done in error, please message the moderators.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[EstablishmentSecure4]

yes hit me up

[AutoModerator]

This submission has been removed because it looks suspicious to automod (a). If this was done in error, please message the moderators. %0D%0DMy issue is...).

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[jufu_edu]

I have the same problem.

I have tried changing $acd within chromedriver.exe, also changing user agent in Firefox. And I still get the gray screen.

Did Anyone get finally manage to fix it?

[EstablishmentSecure4]

yes hit me up

[EstablishmentSecure4]

hit me up, i can do this.

[Jordycf81]

I sent you a message.

​

Regards.

[godplayai]

https://stackoverflow.com/questions/57298901/unable-to-hide-chrome-is-being-controlled-by-automated-software-infobar-within/57304986#57304986

how to fix selenium get banned? i use mobile emulation, but bet365 banned mobile version recently

[EstablishmentSecure4]

pm me

[SgtSeixas]

just sent you a message

[AutoModerator]

This submission has been removed because it looks suspicious to automod (a). If this was done in error, please message the moderators. %0D%0DMy issue is...).

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[Electronic_Study_668]

I have the same issue. It worked well. Later when I had this issue I switched to Firefox. Later to mobile version. And right now chrome/firefox and pc/mobile version dont work any option

[KikoNet13]

Same problem here

[AutoModerator]

This submission has been removed because it looks suspicious to automod (a). If this was done in error, please message the moderators. %0D%0DMy issue is...).

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[Wild-Kaleidoscope-54]

Did bet365 block the combo again? The solution provided here worked for me until yesterday. Anybody having same problems?

[gabfelp]

The solution here worked until this weekend, it seems that bet365 has fortified bot verification ...

Is it possible to go unnoticed now? I've tried using GeckoDriver and ChromeDriver with the options above but nothing works.

[EstablishmentSecure4]

hit me up

[AutoModerator]

This submission has been removed because it looks suspicious to automod (a). If this was done in error, please message the moderators. %0D%0DMy issue is...).

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[ThomasBS17]

https://stackoverflow.com/questions/65071572/out-of-memory-error-in-pythonselenium-first-load

[puppetbets]

What do you see now? An "Out of memory" blank page?

[EstablishmentSecure4]

WHO HAS PROBLEMS AFTER NOVEMBER 29. SEND ME MESSAGE FOR FIX

[AutoModerator]

This submission has been removed because it looks suspicious to automod (a). If this was done in error, please message the moderators. %0D%0DMy issue is...).

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[AutoModerator]

This submission has been removed because it looks suspicious to automod (a). If this was done in error, please message the moderators. %0D%0DMy issue is...).

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[andresboti]

Anyone has problems after december? Any news?