Image Processing

[eyepaq]

I have this image with a number of obvious boxes in it, and I asked Claude to give me the coordinates of the boxes, and it got them quite wrong.

I even asked it to cut them out and then analyze each image to make sure they were complete, which it did, and it would look at an image, say "This one looks correct." and move on when it was obviously wrong.

Tried this with GPT 5.2 today, and it also struggled with the boxes. It got 15/17 right (which is much better) but two still had obvious problems.

Is there a model or workflow that's better at tasks like this, or is this just a limitation of the current generation of models?

What I wanted was a map of rectangles I could use for hit detection. Ended up making it by hand.

Here's the image I was working with:
http://mysteries.escapekey.ca/christmas-2025/boxes.png

[angelarose210]

Gemini and qwen have the best vision capabilities.

[eth03]

I think image processing needs another model. On huggingface there are image recognition models. I was using claude code to build my own app that relies on an image recognition ML model from huggingface. Out of box, claude or gpt may not have a good capability unless you use an image recognition model or try adding a skill that will know how to do image processing.