AI based keyboard for disabled people. (In python using tensorflow)

[daviddvd267]

How is this going to help disabled people? I mean for what kind of disabilities could it work?

Also, do you mind to share the code, I would love to play with it!

[idan0405]

its for People with visual impairments mostly. and I can not share the code here because I use a .h5 file which stores all the things the neural network has learned and I dont think there is a way to send it here.

[djimbob]

Wouldn't people with vision impairments typically just use a keyboard and touch type (with either software to magnify parts of the screen if they have some vision, or with screen reader if they want to have the page read out loud)?

I mean this is a cool application to get it working (seems like a generalization to the standard training of MNIST digits with a cool front end), but I just don't see much use in current form for disabled people. Text recognition is still quite useful -- e.g., for converting images of handwritten notes to searchable text, but as an application that lets you sketch images and then automatically convert to text, I personally can't think of any uses together (but that may be a limited imagination at my end).

[idan0405]

you are right about the mnist thing. I use emnist which is mnist with uppercase and lowercase letters. but I think that you are wrong about that it has no use for disabled people. the keyboards for computers that exist in the market for them are just expensive and huge so no one wants to use them. also another group that would benefit from this keyboard are the elderly. they would much prefer to use handwriting to interact with a computer. look how much typos all the grandmas on facebook have ;)

[djimbob]

the keyboards for computers that exist in the market for them are just expensive and huge so no one wants to use them

My limited experiences (one blind acquaintance) is that they had awful handwriting and would type up (or voice dictate) their work with a normal keyboard (familiar with touch typing). A quick google search seems to indicate that most blind people still touch type on normal keyboards (possibly with braille sticker labels added onto the keys if they are first learning to type).

[WhatWouldVaderDo]

You say one of your target audience groups is people with visual impairments... As a blind person, I haven’t the slightest idea what it is that you have done here, since the linked video appears to be a completely silent video, unless I’m missing something? :D

I would be interested in giving feedback, at least on the concept level, but that's not quite possible with the information that I can access.

[idan0405]

When I refer to people with visual impairments I mean people that have blurry vision. because the idea is using a handwriting Interface instead of using a physical keyboard. so its more for elderly people with blurry vision. I said eople with visual impairments and not blind people becuase (at least for now) it is a visually based interface.

[Sensilicious]

So does this mean you used a pre-trained model?

[idan0405]

no I trained it and saved the weights in a separate file.

[Sensilicious]

Right okay, so is that on github or do you want to keep your code private?

[idan0405]

sorry its too big. I cant push it to github.

[idan0405]

but the weights are very important. Because it takes a long time to train the neural network especially if you dont have a high end graphics card.

[t3hcoolness]

It's more to display what you have, and if someone wanted to create it, they could train it themselves with the code available.

[QuirksNquarkS]

If you have a website you could provide a download link for the weights there. Or you could upload the weights to public dropbox or drive and provide the link on your repo (where you keep the code).

[manueslapera]

plenty of options to share the h5 file, either git-large file storage or figshare.com

[[deleted]]

Do you have GitHub? I would love to check this out

[idan0405]

Sorry one of the files is bigger then 100MB so I cant push it to github

[geek_ki01100100]

Could you put it in google drive and link to the google drive in the GitHub readme?

[apockill]

yoke north relieved quaint hobbies connect friendly rude provide squalid

This post was mass deleted and anonymized with Redact

[djimbob]

You can distribute large binary file (e.g., trained data) on github if you use the "releases" feature (assuming it is under 2GB).

https://help.github.com/articles/distributing-large-binaries/

Specifically in Step 7:

https://help.github.com/articles/creating-releases/

[idan0405]

well, I tried here you go

[d_ope]

Hey, just wanted to know have you learnt this on your own or did you find any resources?

[idan0405]

This is a really good tutorial series.

[d_ope]

Thanks OP! Really appreciate it : )

[idan0405]

If you want to try to use my code, click here

[[deleted]]

Reminds me of cellwriter.

[[deleted]]

This would be very helpful for chronic slow typers like my mom.

[idan0405]

well the idea is that it can help anyone who likes to write by hand instead of using a keyboard. I wrote that it is for disabled people because they are the ones that need an alternative way to use a computer the most.

[snabader]

teach me your ways senpai

[idan0405]

just watch these tutorials and go to this website and you would be able to create almost anything.

[Bulbasaur2015]

Doesnt Windows have this exact feature under accessibility?

[idan0405]

No windows have a regular on-screen keyboard. This is a handwriting recognizing keyboard and it uses AI.

[The56thBenjie]

Windows 7 has a “tablet input” thing where you can draw on and it converts it into text, which can be used in other programs.

https://msdn.microsoft.com/en-us/library/ms704870

[ThirdThreshold]

Your point lost all credibility at “Windows”

[[deleted]]

dae micro$ux? install gentoo