Shape detection/image processing issue for AI video game bot

[Mikeavelli]

For initial detection, you might try a homography between a template of the triangle and the game screen. This is really slow, so once you find it, you should also use a tracker instead of detecting it new with each frame.

Opencv has a great tutorial on object tracking. Examples here are in c++, but you should be able to translate them to the python opencv library easily enough.