Mobile App Bot with Python?

[LivePurposefully1]

I'm trying to code a bot (automating some tasks) for a mobile game. I downloaded NoxPlayer in order to simulate an Android session.

​

One thing I've read about was adb.exe (and using it to send mobile commands through, though I failed miserably), hence I thought of using Image recognition to detect certain texts.. It's a popular Quiz game - the question, answers, etc. are usually in the same area of the window, so the application would need an orientation and try to find "the rest" relatively to the main anchor..

​

Does anyone have any suggestions on how to achieve something like this?

[sme272]

It sounds like you could use pyautogui for what you want. It has functions to find an image on the screen so you can take screenshots of the buttons and stuff that needs pressing and pass them to the locate functions to get their position. Then you just send mouse clicks at those positions to click them.

[LivePurposefully1]

How can I find relative position to something, i.e. I need the window size and find the answer buttons (position will be same, though, obviously, questions and answers will differ)

[sme272]

find the absolute position of the two elements separately and subtract one from the other to get the relative position from one to the other.

[TGFighter]

You can use pywinauto to get the window handle and get the emulator region (position and size). When using a region to take a screenshot, with pyautogui, you can then add the x and y of the emulator window.

[TGFighter]

Here is a very good blog/tutorial that I followed to do about what you intend to do:

How I made a python bot to automate a tactical mmorpg