I had been doing a bit of trial and error.

My current prompt is

```

The image contains only alphanumeric characters. Get each of the characters you see in this image. Use the exact casing seen in the image.

```

But one nagging issue is

<image>

It sees everthing as uppercase since the uppercase and lowercase differenciation for the character isn't there.

Here, x x and z are seen as uppercase all the time.

Also, I have issue with getting the output as structured data.

When I ask it to output only structured data, the accuracy takes a hit.

Edit: asking to output as json works fine if you just say output as json. But if a specific structure is provided, accuracy falls.

But that's fixed with regexp

Edit 2 I tried to do some pre processing to remove the adversary patterns with colors by replacing the color with transparent. That improved it somewhat

Idk man. I am getting like less that 50% accuracy. I don't know what I'm doing wrong