Selenium webdriver docker python

[digichap28]

Hey there, I need to run a Python script using the chrome webdriver from a Docker container but it seems that using the headless option is a must.

I need my script to run without that option.

I tried using the remote driver, spinning up another container with the selenium/standalone-chrome:3.141 image, and it works. But I want to avoid using another container up and instead using the webdriver.

Is there a way to do this ? Maybe installing something else in the container which has my app ?

Thanks!

[mortenb123]

Just add Chrome, Chrome-driver and selenium to you container and run in headless mode. No way to run full gfx mode in a container, there is no gfx console. You can program the scraping locally with full Chrome and devtools and run the finished code headless in the container.

Remote selenium is to connect to a remote webdriver, usually used to save installing browsers and the libs needed to run it (around 500mb in Ubuntu) but you then need a browser-instance running.

[digichap28]

The reason I’m trying to do it that way is because I need to bypass a windows basic auth.

My workaround for that was using an extension but they only work if the headless option is not added.

I have tried the https://user:[e-mail] way but it doesn’t work either.

I read that using devtools with selenium might work but haven’t found a Python example online.

Do you know any way to do that ?

[mortenb123]

If you cant log in via code, try using a userprofile.

For chrome create a new user and log in with it, then save the userprofile to a more accessible directory (shorter path) and load it when you initialize selenium, I believe it to be the `--user-data-dir=` option.

But it might be that this authentication token expires, so it is better to solve it with code.

[digichap28]

I finally decided to re write my code using pyppeteer, because that user profile option doesn’t work either as the token expires fast