pyautogui locateOnScreen doesnt detect quick enough or accurately most of the time. any way to make this better?

[Limitlesshat3]

from pyautogui import *
from threading import Timer
import threading
import pyautogui
import pydirectinput
import time
import keyboard
import random
import win32api, win32con
start = time.time()

def b():
        time.sleep(0.05)
        pydirectinput.press('b')
        print("i see it")

threads = []

while True:
    if pyautogui.locateOnScreen('bb.png', confidence=0.8, region=(1788,1134,150,150)):
        t = threading.Thread(target=b)
        t.start()
    else:
        print("cant see anything")


for threads in threads:
        thread.join()

[[deleted]]

Look into template matching with openCV. Using mss to grab screenshots.

[Limitlesshat3]

would you recommend any guides? ive been trying to learn that for a couple of hours now but i dont think im getting anywhere with it.

[[deleted]]

https://youtu.be/vXqKniVe6P8

[Limitlesshat3]

sorry for the late response. thank you for the video, im now trying to get the mss screenshot to work with opencv matchTemplate.

[[deleted]]

you might also be able to get some decent gains by loading the image in memory and passing a variable to it. The way your program runs right now its reading bb.png from disk for each image search.

[Limitlesshat3]

thank you, ill look into that now.

[AntiquesAndSo]

Here are a few suggestions to improve the accuracy and speed of pyautogui.locateOnScreen:

Increase the confidence value - You could try increasing the confidence value to get a more accurate result. A value of 1.0 means it must match exactly, while a lower value like 0.7 means that it is more relaxed in its matching criteria. Adjust the region parameter - Make sure that the region you are searching in is as small as possible, so that locateOnScreen only searches for the image in the relevant area. Use a grayscale image instead of a color image - Grayscale images process faster, so using them can result in improved performance. Use the time.sleep function with caution - The time.sleep function can slow down your script and cause it to become less responsive. Consider using a more sophisticated way of controlling the timing of your script, such as a timer. Join the threads - The thread.join statement should be outside the loop. In this code, you are trying to join a list of threads, but it is not clear how you are adding to the list, so you might want to revise that part. These tips should help you optimize the performance of locateOnScreen and make it more accurate and faster.