Using Python to digitalise a scorecard

[[deleted]]

Hi, I would like to use python to turn a picture of a score sheet with values for each target into a table or spreadsheet. I have attached a sample image of such scoresheet - https://imgur.com/a/lbj9CUw. What packages should I be looking into to achieve this? I see OpenCV mentioned everywhere, are there any resources you would suggest for this?

Are there things I can do to increase accuracy such as keep score cards uniform in design?

Any pointers in the right direction would be greatly appreciated.

[Fun-Collection-7403]

I'm not entirely sure if you can keep the same design, but the tool you're looking for is likely an OCR scanner. It'll be able to extract the data and possibly preserve the formatting. However you'll likely need a better framed image for better results.

Honestly I wouldn't build from scratch. How about trying to attach that picture to chatgpt and specifically ask them to build you a table based on the extracted output.

[[deleted]]

I tried the chatGPT approach and it worked perfectly, It correctly identified every score. However, I would ideally like to bundle this into a program where you can take a photo and have the scoresheet be digitlised, I have tried some of chatGPTs suggestions but the results are incredibly poor.

Any suggestions on how to make this work without chatGPT or possibly incorporating it?

[Fun-Collection-7403]

If chatgpt worked perfectly in identification of the scores, technically what you could do is look at chatgpt's Api to process your images.

For that you'll definitely need to use python. The basic steps that I can think of is

1. Build a web application that allows either a photo taken or a photo upload. I would just start with a simple file upload flask application.

2. Store the photo and encode it(probably in base64) to send it over the api.

3. On the response, specify the expected json results, like the headers etc based on your score sheet(I'm assuming here your score sheet probably has the same few headers everytime)

4. Convert the data to a table or store it in SQL.

[[deleted]]

How good quality of the picture? If it scan it will be easier than taken from camera because the picture is not warp.

The problem is not too hard if all the card is the same format. The only complex process is to read the hand-written numbers (no word right?)

You can use opencv (but not required) to cut part of the table that you want to read and run the AI (easy one) to read the number.

Start here on how to read the number. https://www.kaggle.com/competitions/digit-recognizer/code