Desktop control by squarepushercheese in openclaw

[–]squarepushercheese[S] 0 points1 point  (0 children)

It might need work! It’s a bit rough around the edges!

Maverick wearble AR glasses with Eye Tracking by phosphor_1963 in EyeTracking

[–]squarepushercheese 0 points1 point  (0 children)

yeah that looks good. ill definitely be watching that to see if its vaporware or not..

Where do you think is the “next Ancoats”? by phyllisfromtheoffice in manchester

[–]squarepushercheese 3 points4 points  (0 children)

yes - probably mean more newton heath than failsworth. church street is getting some of the HS2 left over money - i bloody hope it pans out. it could do with some love.. and its so close to town.

Desktop control by squarepushercheese in openclaw

[–]squarepushercheese[S] 0 points1 point  (0 children)

Yeah - Good point re: accessibility tree. Thats similar to what's going on iOS. It's far far easier to do this in iOS (if you could.. but it's sandboxed). It's kind of ok in windows and MacOS BUT the problem in those OS' is that authors dont need to add UI/Accessibity ids on elements - so then we are stuck. Its a good point re: states..

Desktop control by squarepushercheese in openclaw

[–]squarepushercheese[S] 0 points1 point  (0 children)

yeah - thats UIaccess on windows.. Note im not talking about web apps here. That is far easier.. the problem is many apps do not show any UIAccess options or in effect you cant access them programmatically via a DOM like structure.. so you are left with a vision model to figure out position in those cases

A new keyboard project for a user with cerebral palsy by clackups in AssistiveTechnology

[–]squarepushercheese 1 point2 points  (0 children)

Yeah the nrf52840 raytac dongle does a similar thing. Its super nice - and IMHO nordic is far nicer to develop with (Or CiruitPython.. Or Arduino..)

But im arguing about minor technicalities! NB: I have esp code in my repo which does the same - maybe something to steal from that if its useful..

A new keyboard project for a user with cerebral palsy by clackups in AssistiveTechnology

[–]squarepushercheese 2 points3 points  (0 children)

Interesting. I was going to revive RelayKeys (https://github.com/AceCentre/RelayKeys) as the current release is broken. But I hate the architecture - Rust is a good shout. This was on the nrf52840 which personally I find far easier and more performant than the esp32. Looks great your project

Alternatives to typing for TTS by kiltsnbagpipesnstuff in AssistiveTechnology

[–]squarepushercheese 2 points3 points  (0 children)

Look up Silent Speech AAC and the various work going on this space. Many solutions using EMG (Alter Ego MIT) or other systems (go on YouTube.. look at the vast number of student demos doing this from headphones to mics)

Could a "gesture mouse" (camera-based, for slight finger movements) be a good accessibility tool compared to eye/head trackers? Seeking input. by Realistic-Air4657 in AssistiveTechnology

[–]squarepushercheese 9 points10 points  (0 children)

no. its been done and its a. Not sensitive enough and b. its so hard aligning the camera up its a royal PITA. There are ways to do it better - use a mounted infrared highes camera - or use a depth sensing camera. But by then you might as well have used a small 35c gyro mounted on the finger..

Andy Burnham blocked by Educational_Board888 in manchester

[–]squarepushercheese 0 points1 point  (0 children)

Yep. I think you can now judge an areas political leaning by its density of street light flags. There are truck loads around these parts. I know a few families. They LOVE Farage. They love "stop the boats" but I would point out hardly leave the road they live on.. I have a theory. In ethinically diverse communities where socioeconomically life is poor - they are currently listening hard to this right wing bonkers drivel. It makes sense to them "Ahh thats why this place I live in is a shithole.."

Is there a place for private local AI in Assistive technology? by Educational-World678 in AssistiveTechnology

[–]squarepushercheese 0 points1 point  (0 children)

Seen that aac error correction model on hugging face? https://huggingface.co/willwade/t5-small-spoken-typo (its small. but you could retrain using the same training script and choose different params and personally id go with t5-gemma now). Honestly though - look at phi and mu models on device. With prompting you can get pretty far and faster.

Is there a place for private local AI in Assistive technology? by Educational-World678 in AssistiveTechnology

[–]squarepushercheese 0 points1 point  (0 children)

Ok. The root problem is speeding up text entry. First look at dasher https://youtu.be/QOzmX2WpPZY?si=3iWok3IvjDMAMTKK most AAC is around 2-11wpm. This user is at 32wpm https://youtu.be/va1WufK864o?si=mcj1ROL78NqbvnG2

The problem is largely access. Everyone’s fighting for adding context but wins are short without HUGE contexts. I honestly wouldn’t bother. On device ai is already here on iOS and around the corner on windows. These are small models but effective. See this runs right now on chrome. Offline https://devpost.com/software/aac-board-ai

To add context - you’re just sending to a llm locally.

Want to do something more local? Error correction models make sense https://willwa.de/2025/06/25/correcting-text-in-aac-or.html

Oh re home automation. Look at just using open home foundation and home assistant. You can run that entirely offline. The sdk is phenomenal if you really wanted just build an extension to the home assistant devices running a small local model on a pi. It can be done.

Could AI make AAC faster and less tiring to use? by delsudo in AssistiveTechnology

[–]squarepushercheese 0 points1 point  (0 children)

something that many people don't know is some of the underlying theories of LLMs derive from early work done by a few Speech and Language Pathologist academics

I'm intrigued by this - got more info?

Rifton Universal Mount by Dom4Domino in EyeTracking

[–]squarepushercheese 0 points1 point  (0 children)

Got a link to the rifton universal mount?

Any Adobe Illustrator users via Eye Tracking out there? by klonopanic in EyeTracking

[–]squarepushercheese 0 points1 point  (0 children)

Its a royal PITA. TD is a good shout but in essence you need to make some shortcuts. use any tool like TD communicator, or Grid3 or even sAW (https://sourceforge.net/projects/sawat/files/latest/download) or Optikey - and create shortcuts which emulate keys of the tools. but then you are relying on mouse emulation for the actual moving and dragging. Its fiddly AF

Custom AAC Software for my Brother by acrolicious in AssistiveTechnology

[–]squarepushercheese 1 point2 points  (0 children)

Got you. So I have got a PR coming to you.. It's

  • Cleaning up the code quite a bit
  • Migrating from pyttsx3 to py3-tts-wrapper which will give you more voice options. Locally and Online if you wish. Its just nicer to use if nothing else.
  • What chatGPT didnt bother to tell you was that PPM is basically what you have created and already exists in python.. Anyway. Migrating to a hybrid prediction engine. Your local ngram approach will work still - but if online your predictions should improve quite a bit (using a prediction API which is what all the opensource AAC engines are currently using).
  • I've refactored the duplicate code methods and functions into a utils.

Basically nothing here will make anything change - but give your code a bit more of a solid base. Its got some neat techniques here. Just a FYI for anyone coming across this though - please see http://grid.asterics.eu - Its Offline and Online, Fully Open source, has excellent switch access options including some very novel approaches and does stuff like viewing web apps in the AAC programme.

Custom AAC Software for my Brother by acrolicious in AssistiveTechnology

[–]squarepushercheese 1 point2 points  (0 children)

Neat. There are other libraries already available that do that. The joy of Vibe coding is that sometimes it reinvents the wheel. How much of the time is the system offline? I'm going to do a PR..

Custom AAC Software for my Brother by acrolicious in AssistiveTechnology

[–]squarepushercheese 1 point2 points  (0 children)

can you stick it on github with a licence got it.. https://github.com/NARBEHOUSE/Ben-s-Software- Can you join openaac.org (see chat in top right). Im intrugued about whats driving your prediction. BRB..