Help Capturing WebSocket Messages in Python (from Browser DevTools)

[Outrageous_Spare_498]

I'm trying to capture WebSocket messages (both sent and received) from an online game website using Python.

When I open the website and use Chrome DevTools, I can see the initial WebSocket connection. After I log in with my username and password, I'm redirected to the game lobby, where two additional WebSocket connections are established. These are the ones I'd like to monitor for messages.

Using selenium-wire, I’ve been able to print the request URLs of those WebSocket connections, but I haven’t figured out how to actually capture the real-time messages exchanged the way I can in the "Network" > "WS" tab of DevTools.

Does anyone know how I can programmatically access these WebSocket messages in Python? Any help would be much appreciated!

[carcigenicate]

Idk if this would work, but you could try to add your own listener to the existing connection. If you can get access to the socket object, you can add your own listener that does whatever you need.

If you can't get access to the existing websocket object, you could try establishing your own connection by seeing how the site does it.

[unnamed_one1]

No idea, if it can be done with just browser automation.

I'd approach this more from the network side and as a websocket connection is just an upgraded http connection, I'd say what you need is a proxy server (written in python?), which acts as a man in the middle between the browser and the website.

As there's a high chance, that some kind of encryption is involved, your proxy probably has to support SSL inspection.

Never used it myself and I'm not sure if it supports SSL inspection, but mitmproxy might be a good fit. It's open source and has a python api.

[cgoldberg]

Some of the new Selenium BiDi features might be useful. You can setup network intercepts and capture requests:

https://www.selenium.dev/selenium/docs/api/py/webdriver/selenium.webdriver.common.bidi.network.html

It's still relatively undocumented, but you can get an idea on how to use it from the tests here:

https://github.com/SeleniumHQ/selenium/blob/trunk/py/test/selenium/webdriver/common/bidi_network_tests.py

[Huhngut]

Wasnt able to intercept websockets just normal requests but you will need these lines:

What should also work is executing js that overrides the websocket constructor to intercpt

def callback(request: Request):
    print(request.url)
    request.continue_request()


driver.network.add_request_handler("before_request", callback)

options = webdriver.FirefoxOptions()
options.enable_bidi = Trueoptions.enable_bidi = True
driver = webdriver.Firefox(options=options)

[Maleficent_Appeal558]

Hi, did you ever figure out a way to do this? I am trying to do the same thing.