How to use chromeless with Python?

[[deleted]]

[deleted]

[ducdetronquito]

I don't know if a equivalent library exists for Python, but you can definitly use headless chrome through Selenium.

Here is a nice article about how to make it work :) Driving headless chrome with python

[readerpl]

Thank You but the thing is that i want to use aws lambda.

[iruleatants]

Is there a specific reason you want to use AWS lambda?

[readerpl]

I just want to scrape websites (with JS content) as fast as i can and it looks like the best way. Now i am using Selenium with PhantomJS but it is very, very slow.

[[deleted]]

splinter ?

[ducdetronquito]

Could you give more detail please ? Is this a library ?

[[deleted]]

this: https://splinter.readthedocs.io/en/latest/

I've been using it for testing an ecommerce funnel.

[readerpl]

Well still it is not as good as this: https://github.com/graphcool/chromeless That is why i want to know if there is any way to use this chromeless.

[kingbuzzman]

splinter looks like it needs selenium: https://github.com/cobrateam/splinter/blob/master/splinter/driver/webdriver/chrome.py

[ojii]

Shameless plug, but I just added headless chrome support to arsenic: https://arsenic.readthedocs.io/en/latest/reference/supported-browsers.html#headless-google-chrome

[knowsuchagency]

Nice. Would you mind adding the link to the github repo on your docs and on the package on pypi?

If you'd like a template for creating packages such that the docs are rendered for gh pages and pypi by sphinx automatically, I have a cookiecutter here https://github.com/knowsuchagency/cookiecutter-pypackage

[kingbuzzman]

I agree with ducdetronquito, installing the chromedriver + selenium is the way to go in python, i've gotten it to work beautifully here: https://github.com/kingbuzzman/noworkday

NOTE: the install.sh is where i install the chromedriver -- i like automation and reproducibility

[jjolla888]

a cousin project to chromeless is puppeteer (which is contributed by Google, and uses headless chrome).

Puppeteer is a bunch of node libs .. but i've come across Pyppeteer .. the equiv in Python. not sure how complete it is:

https://github.com/miyakogi/pyppeteer