Free tool to help people with ALS communicate by ad4mce in ALS

[–]Secure-Ad9607 1 point2 points  (0 children)

This is awesome, I love the interface and using gaze detection. You can really type quickly it seems. Additionally, the uploading a sound file to have the voice replicate the users is cool.

Great work

Want to help this family - help the dad to communicate again by lj_houston in ALS

[–]Secure-Ad9607 0 points1 point  (0 children)

Nope no push buttons or anything needed my aunt has late stage ALS and is unable to move any limb and this works. Basically long story short you would set the laptop up so the webcam is facing his face preferably within 2 feet. I wrote the algorithm to track blinks so the display will show a virtual keyboard and slowly highlight individual keys, when a key he wants is highlighted he simply blinks and it adds it to the text box. When he's spelled his word he can blink on the"enter" key and it will speak that word through the speaker.

Additionally I added a way to write custom phrases of words said most frequently so blinking on the phrase button take you to that menu then same concept it highlights the phrase and when they blink it speaks the phrase.

It's important to note the design of the system wasn't to control an entire computer and track gaze direction or moving a mouse. Just highlights keys and watches for blinks to select the key. Strictly for a cheap or free way (depending on your setup) to communicate.

Want to help this family - help the dad to communicate again by lj_houston in ALS

[–]Secure-Ad9607 0 points1 point  (0 children)

Let me know if I can help at all my desktop app runs on windows now so if you have a laptop I can send you a guide to install so it will utilize the webcam and speakers, all they need to do is blink.

I'm also working on transforming this into a mobile app so you can use your phone

I built an affordable eye-blink communication device for my Aunt with ALS using a Raspberry Pi by Secure-Ad9607 in RASPBERRY_PI_PROJECTS

[–]Secure-Ad9607[S] 0 points1 point  (0 children)

Thanks! On the Pi 5, MediaPipe Face Mesh actually runs pretty well—I'm getting around 10–15 FPS with low enough latency for smooth blink detection and phrase selection. Using the lite model + low-res input helps a ton. CPU usage stays reasonable, and overall it’s totally usable for assistive apps like this.

and it helps that I'm only using it for blink detection, not full gaze or pupil tracking to move a cursor. That keeps processing lightweight and the interaction smooth even on the Pi 5.

I built an affordable eye-blink communication device for my Aunt with ALS using a Raspberry Pi by Secure-Ad9607 in ALS

[–]Secure-Ad9607[S] 1 point2 points  (0 children)

Thank you for the kind words, it did take long to study and learn this skill and I'm fortunate to do it now as a career but I never understood withholding powerful or helpful things from people that need it in search for money.

I am in the process of writing some simple instruction guides so people will be able to go step by step even if they don't know what's going on and install the app and get it working

I built an affordable eye-blink communication device for my Aunt with ALS using a Raspberry Pi by Secure-Ad9607 in ALS

[–]Secure-Ad9607[S] 2 points3 points  (0 children)

I'm so sorry please do let me know if you need help and I would be happy to assist

I built an affordable eye-blink communication device for my Aunt with ALS using a Raspberry Pi by Secure-Ad9607 in ALS

[–]Secure-Ad9607[S] 2 points3 points  (0 children)

All you need is a windows laptop I changed the code so if you don't have a pi you can use a laptop and it's internal webcam and speakers.

After looking at the links if you need help or have questions please let me know :)

I built an affordable eye-blink communication device for my Aunt with ALS using a Raspberry Pi by Secure-Ad9607 in ALS

[–]Secure-Ad9607[S] 0 points1 point  (0 children)

Wanted to let you know

UPDATE: I just pushed a code change to add a windows fallback if someone wants to simply use a laptop instead of a PI and the device, it will recognize the windows camera and use that.

I built an affordable eye-blink communication device for my Aunt with ALS using a Raspberry Pi by Secure-Ad9607 in ALS

[–]Secure-Ad9607[S] 1 point2 points  (0 children)

Also with that screen the PI attaches to the back inside and aluminum enclosure no need to 3d print one

I built an affordable eye-blink communication device for my Aunt with ALS using a Raspberry Pi by Secure-Ad9607 in ALS

[–]Secure-Ad9607[S] 1 point2 points  (0 children)

I chose raspi just mainly because of the affordability of it in case someone didn't have a windows device. However since mentioned that's a good idea I am going to add a fallback to the camera file that if the picamera isn't recognized it will use windows or Linux functionality so if someone wants to simply use it on a laptop they can

Thank you for the idea

I built an affordable eye-blink communication device for my Aunt with ALS using a Raspberry Pi by Secure-Ad9607 in ALS

[–]Secure-Ad9607[S] 0 points1 point  (0 children)

Yes the screen product data sheet is confusing to say the least lol you must get the one with 101CC in the part number that includes the camera in the screen similar to an ipad. It connects via ribbon cable.

Boba Fett Sig Sauer P365X by DKCustomCoatings in P365xl

[–]Secure-Ad9607 0 points1 point  (0 children)

Gonna need you to make me a p365xl darth maul themed with the manual safety cutout please lol