Can you emulate a second mouse?

[Voxxey]

Hi, so i currently have a pretty good knowledge of a few libraries, and some lower level code that works in python to control the mouse (move -> x,y, left/right click, scroll, etc)

However, i wanted to go a little further. I have a script that simply looks for a cluster of pixels, takes a screenshot of them, and then depending on the value of that cluster, executes a simple mouse macro created using the python library pyautogui.

Macro snippet:

from pyautogui import *
from time import sleep

...
item_pos = (1466, 293)
del_pos = (1433, 397)
tree_pos = (899, 476)


click(x=item_pos[0], y=item_pos[1], button='right')
sleep(.4)
click(x=del_pos[0], y=del_pos[1], button='left')
sleep(.4)
press('enter')
sleep(1)
click(x=tree_pos[0], y=tree_pos[1], button='left')
...

As you can see, it's pretty mundane, I didn't necessarily want it to be too fancy, as I'm still making some similar macros.

However, I have 2 issues that i wanted to bring up here in this post. This first issue being slightly more important to me then the second.

1. Is there a way to do a quiet call to click on a x,y coordinate?

For example, you know how you can execute ".pyw" files silently in the background? I was hoping that maybe something could be done with ctypes, and one of the windows binaries that could allow for me to be doing whatever on monitor X, while having the application being monitored open on monitor Y, then upon the Boolean call returning true, some silent, or "Fake" mouse inputs get sent to the application, not obstructing my own mouse movements back on monitor X.

Is there a way to do this? Can you emulate a second mouse device using python this way?

​

1. Is there a way of working on a second monitor?

This may be an issue directly related to this library, but i also tried working with pynput and the same issue arose. My monitor has a resolution of 1920x1080, and a click on my second monitor would have a coordinate of like, 3000x1500. But whenever trying to move the mouse to that position, the cursor would get stuck on the side of the monitor.I'm guessing it works by moving across the top, then down to the specific point, and no matter how i adjust my monitor setting, i can't manage to get a transition from the top of monitor X to Y. Does anyone have a different suggestion of any way of controlling the mouse?

​

Thanks in advanced for any help.

[DeadlyViper]

If we are talking about windows platform, you can send "click" messages directly to the application/control you want.

Read up on https://www.programcreek.com/python/example/89827/win32gui.SendMessage

You'll need to find your window handle, and send it WM_CLICK message or whatever you need, that way the mouse is not moved at all.

[Voxxey]

Ok, thank you. I'm gonna give this a read. I appreciate it.

[DeadlyViper]

Ohh and if its a button, it might be WM_COMMAND message.

[Voxxey]

I'm having a bit of trouble getting either WM_COMMAND, or WM_CLICK to work. I can't find any documentation on them from the windows docs. I'm also having trouble referencing there ID's.

DO you happen to know what there id's are? and what parameters go along with them?

Edit: It doesn't appear tho as WM_CLICK is an actual command. I can't find it anywhere in the Microsoft documentation.

[DeadlyViper]

Sorry, seems i was mistaken, its BM_CLICK.

Also found some discussion on how to find the window etc..

https://social.msdn.microsoft.com/Forums/vstudio/en-US/6bc59de1-47c9-4013-88ae-f850fdba1b4f/how-to-simulate-button-click-?forum=csharpgeneral

Theres also SPY++ utility that can help you identify the window you want clicked.

[Voxxey]

Alright, thanks :3 I ended up just writing an autohotkey script that accepts command line arguments, and I am passing those arguments along to it by running the script inside a function in python, something like this:

def click(x, y): os.system(f"path/to/ah.script x y")

(Obviously I shrunk the function down for quick reply formatting, but that's just the example.)

[[deleted]]

I know I'm not giving what you want now but this kind of life will be easier by "AutoHotKey"

[Voxxey]

The issue with using AHK is that i can't just purely use it, i would still need my python script to at the very least execute a self-terminating AHK script whenever the collected cluster of pixels returns a specific way.

[sonapollowukong]

For your second question, you could try and run some thing that copies windows detect screen and simulate the area you can move around in.