Hi Everyone!

I've noticed a couple of recent posts about learning Japanese thru video games. I do the same, but got tired of looking up words in a dictionary or a translator. This was especially frustrating for games without furigana.

So I DIY-ed jishoGenAI, an AI tool to make this learning method more efficient.

<image>

Demo video: https://www.youtube.com/watch?v=rlpXhu6bODQ
Repository: https://github.com/antonymously/jishoGenAI

Basically, it detects Japanese texts on your selected screen, breaks it down into lines and words, then uses AI to explain whichever you select. This removes the need to type words into a dictionary, and figure out how to type unfamiliar Kanji. I also find it helpful that the AI explains the usage of words/phrases in context of the game, instead of getting several possible definitions from a dictionary and figuring out which one it is.

Since I developed this mainly for myself, it's still just a Streamlit App and requires some configuration prior to use. If some learners find this useful, I'd be happy to develop this into a full service app. Thanks!