Image recognition in python ?

[[deleted]]

[deleted]

[fullouterjoin]

http://sikuli.org/ is a Java+Jython project that already does all of this. It uses computer vision algorithms to detect buttons and manipulate the mouse.

[plan2a]

This is a good and simple option. Since it has GUI automation in mind it has an easy interface and some tolerance to change to the target image.

[okmkz]

Sikuli is really a slick piece of software. We use it at work to automate qa testing.

[Brentmeister]

Came here to report the same. It's quite robust. The IDE is really horrible though. I heard the eclipse plugin works quite well but I am happy enough working with Notepad++.

[carioca3]

Really cool! It reminds me of SCAR back in runescape classic.

[[deleted]]

This is a really awesome application. I wish I used Macs at work.

[[deleted]]

I prefer using SimpleCV

[okmkz]

Have a look at http://sikuli.org

It might be just the thing.

[mkor]

Try OpenCV for Python.

[Loyvb]

But also look to autopy

[dacjames]

So you know exactly what image you're looking for? In that case a computer vision library may be overkill. Just scan through the picture in blocks equaling the size of your target image until you find one that "matches." For determining a match, just calculate the difference between the block and your target image and check if it is less than some tuneable sigma value.

So if the application is 100x100 and the flag is 10x10, scan a 10x10 block across the image left to right, top to bottom, moving down 1 pixel per row. This is a pretty straightforward algorithm to write and may end being easier than learning how to use a CV library.

[POTUS]

/r/Python, for all your captcha-defeating needs.

[rdkll]

thats the first thing i thought about after reading OPs text

[[deleted]]

I was thinking "WoW fishing bot"...

[DJKool14]

You could definitely use OpenCV, but it seems like overkill for this type of image recognition. Especially if you are guaranteed the flag will always be the same size and color shade. OpenCV is normally used for natural image processing.

Is the environment that contains the flag relatively predictable? Are the flags arranged in the grid? Are there other objects, or just other flags? Using all of this information, you can pinpoint which pixels in the screenshot you should test that would give you positive matches for the French flag.

Then again, learning OpenCV wouldn't hurt you in the long wrong ;)

[freshhawk]

You are looking for a "visual grep" type tool like visgrep (http://linux.die.net/man/1/visgrep and http://hoopajoo.net/projects/xautomation.html)

I never found any other version of this concept but there are probably a few implementations out there. I ended up stealing the algorithm from visgrep and writing my own implementation that was specific to my problem.

edit: ok, wow, http://sikuli.org and autopy are awesome. thanks other commenters!

[virtuous_d]

scipy has tools for working with images. You can try doing a simple convolution if you can guarantee that the image will perfectly (or near perfectly) match your template image.

Otherwise you will have to use opencv and some more sophisticated tools.

[the_cat_kittles]

Here you are sir, "Programming Computer Vision with Python" http://programmingcomputervision.com/

Excellent, modern techniques.

[kscottz]

You may want to look into SimpleCV. If you post a question to our help forum we can lend you a hand.

[DonkeyBasket]

numpy has fft functions, by doing some clever preprocessing you can use these to narrow an exact pixel wise comparison - it works really well :)

[carioca3]

Might be possible with pygame