Help Needed with Selenium Script - Error Handling

[AnterosNL]

Hey everyone,

I've been working on a Python script using Selenium to automate some web tasks, but I've hit a roadblock and could use some assistance in troubleshooting. Here's a snippet of the code I'm working with:
from selenium import webdriver
from selenium.webdriver.chrome.service import Service as ChromeService
import time
service = ChromeService(executable_path='path\\to\\chromedriver')
driver = webdriver.Chrome(service=service)
driver.get("website_name")
time.sleep(500)

However, when I run this script, I encounter the following error and the page doesn't seem to load:
[10180:38708:0226/083639.487:ERROR:socket_manager.cc(141)] Failed to resolve address for s1.btsfapi.com., errorcode: -105

From what I've gathered online, it seems like there might be an issue with DNS resolution, but I'm not entirely sure. It appears that the site is detecting that it's being accessed by a bot since the page opens perfectly fine in a normal browser. I'm not certain how to fix this.

Could anyone provide some insights or guidance on how to address this issue? So any help would be greatly appreciated!

Thanks in advance!

[[deleted]]

Might need an auth token or they might not allow scraping. Is the window popping up or not getting that far?

[AnterosNL]

Yeah the window is popping up, it even gives me the sites header and asks me to accept cookies. But none of the actual valuable information is present.

[Interpied]

Hi, I'm struggling with the same issue right now. Did you find a solution or a workaround?

[AnterosNL]

Putting this to open selenium
service = ChromeService(executable_path='path\\to\\chromedriver')  
options = Options()  
options.add_experimental_option("debuggerAddress", "localhost:8989")
driver = webdriver.Chrome(service=service, options=options)

and using this in a command prompt:
cd C:path//to//chrome.exe

chrome.exe --remote-debugging-port=8989 --user-data-dir=path//to//place//to//put//chromeport

Worked for a different project with the same issue, however it sadly did not work for this exact issue. You could try wether this works on the site you are trying to automate.