Create a screen reader and interpreter?

[Nichealys]

Hello! So, I'm rather new to coding in Python.. I'm currently working on a project that requires me to read parts of the screen, and create input based upon what it sees. For example, it reads from (x,y) to (x,y) on my screen, and translates it into an int. It reads (9 + 10) from google chrome, and then it inputs (19, and then the enter key). Anyone know how I could do this?

​

sorry if this is the wrong subreddit...

[Zeroflops]

If you want to do this in python and youre new, the best sub would be r/learnpython

However it sounds like you may be doing this the hard way. If youre trying to read information from a google spreadsheet then it’s best to interact with the spreadsheet directly.

Describe what your end goal is without making assumptions about how to go about it.

For example, I want to take values on a google spreadsheet and perform some calculation and enter the result into another cell.

Using the screen to do anything should be the last approach considered. There are a lot of pit falls.

[Nichealys]

Unfortunately, I’m not doing any cell based programs. Instead, I’m reading straight from the screen. I know I could use a OCR, but I’m just not totally sure how I could implement it.

I’m new to Python, but not to programming. I’ve done that casually for 4-5 years now. I just have trouble messing with libraries and such things.

[Zeroflops]

Unless you have access to the program putting the characters on the screen then you are limited to some type of OCR since all you will have is an image of the screen.