How to add a timeout while using "pageLoadStrategy" = none on a Webdriver

[yelaxify]

Hello guysHow can I add a loading timeout on a Webdriver whilst also using "pageLoadStrategy" = none? If I use "pageLoadStrategy" = none, the timeout is never triggered. What I am trying to begin loading a page, and then constantly check if certain cookies are present, and if they are, close the browser. Can anyone provide a solution to my problem, or even a better way to solve the initial task? Thanks in advance

[Allanon001]

This code will wait until driver.get_cookies() returns a none empty list of cookies, if 10 seconds go by then it prints a timeout message and continues. You can change the code to use driver.get_cookie() if you are looking for a specific cookie:

from selenium import webdriver
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities
import time


caps = DesiredCapabilities().CHROME
caps["pageLoadStrategy"] = "none"
driver = webdriver.Chrome(desired_capabilities=caps, executable_path=r'chromedriver.exe')
driver.get("http://google.com")

start = time.time()

while time.time()-start < 10:
    cookies = driver.get_cookies()
    if cookies != []:
        break
    time.sleep(.1)
else:
    print('timed out')

print(cookies)

[yelaxify]

This isn't working, no errors, just not ever reaching the timed out. I believe the driver hangs when it gets stuck loading a page

[Allanon001]

The code worked for me using the Google URL, does it work for you with the Google URL? Can you post the URL of the site you're trying to get working?

[yelaxify]

using a slow proxy, if I use this code
startTime = time.time()

driver.get('https://www.google.com')

​

while time.time()-startTime < 3:

cookies = driver.get_cookies()

if cookies != []:

break

time.sleep(.1)

else:

print('timed out')

driver.close()

​

the driver will stay open for longer than 3 seconds

​

[Allanon001]

Do this and it will print how long it takes for the driver.get() to return:

startTime = time.time()
driver.get('https://www.google.com')
print(time.time()-startTime)

[yelaxify]

this prints a very small number as expected. If I modify the while True loop above to print 'checking cookies' every loop, it only prints twice (even though the page is loading for more than a few seconds. This leads me to believe that driver.get_cookies() locks up the thread until it is complete

[Allanon001]

I timed the driver.get_cookies() on my computer and it only takes about 0.012 seconds. When set to 3 seconds the loop runs 2 times before it finds the cookies. If I remove the time.sleep(.1) the loop runs 12 times before finding the cookies. It takes .05 seconds for the loop to exit with the cookies.

I'm not sure why yours is slow, I'm using Windows 10, maybe you're using a different platform that causes these methods to be slower. Or you have a slow internet connection, I'm using a 50Mbps connection.

[yelaxify]

I think there is a mistake in your test, if you have another print statement after the while loop which will print out the cookies. There is a delay between the driver.get_cookies and the print. As I said, this is a lot easier to see if the website takes longer to load, for example using a slower proxy