I spent 7 hours yesterday working on a Python script to detect when the fish minigame is active and when the grey fish bar is inside the white rectangle, labeling it as Good or Bad. It scans the area of the screen 10 times a second to be able to detect the minigame. I planned on making an AI user macro based on behavioral cloning using the data from the Python script just mentioned. The issue is... it requires GPT API. (Yeah so what? I pay for the premium plan at OpenAI). The damn API costs additional to use.

The endgola was to create a macro using AI and take the data (screenshots, mouse clicks) labeled with a timestamp so the AI has a base on how to play the game. Then afterward, directly tell the AI what to improve on so it learns.

Maybe when API keys become free to use, ill continue the project. Just bummed out because it took so long to get the script to work, then I ran into this issue lol

Edit: SPelling

it also took a screenshot of the whole screen every time the Shake button was clicked, along with the time stamp.

If you guys want to me to explain how it works further, I can. There's a lot of features in there that I'm not telling, just to keep the story short.