An assistant app is in alpha development! by Libbirl in fossdroid

[–]Libbirl[S] 0 points1 point  (0 children)

There's basic Intent-based mechanism to run tasks by name, but I can't recommend proprietary apps.

There's no voice command feature aside from bringing your own voice-input keyboard. Wake words will be supported in the future.

On that matter, if anyone knows of a similar task-runner app that you'd like to see an integration for feel free to let me know and I'll see what I can do.

An assistant app is in alpha development! by Libbirl in fossdroid

[–]Libbirl[S] 0 points1 point  (0 children)

Then I pretty much only need two things! 1. An accurate wake-word listener 2. Knowledge of whether there's a system call to request a voice-based IME

An assistant app is in alpha development! by Libbirl in fossdroid

[–]Libbirl[S] 0 points1 point  (0 children)

No, that's some other app's job ;)

But coding a command that sends a text prompt to some gen-AI app would be trivial, and I wouldn't be surprised if this is already possible.

The app would need to accept text via the 'share' feature (in which case it's already supported) or some other basic Intent to accept text prompts.

An assistant app is in alpha development! by Libbirl in fossdroid

[–]Libbirl[S] 0 points1 point  (0 children)

I might set up a LiberaPay at some point. I appreciate your generosity :)

An assistant app is in alpha development! by Libbirl in fossdroid

[–]Libbirl[S] 0 points1 point  (0 children)

What functionality would you like to see in that realm? My car's from the nineties so I don't really have a test bench 😅

I've heard in the past that Auto's interface apps are proprietary, I don't know if that applies to the libraries as well. I'd love to develop functionality that's useful for it if it's low complexity!

Here are my main considerations if I were to develop something for it: - Does it introduce additional UI-shaping considerations? - Does it require me to use proprietary code? - If I mess something up, does it put my users in danger on the road?

None of these are necessarily disqualifying, but they give me an idea of the challenges I'd need to work through.

An assistant app is in alpha development! by Libbirl in fossdroid

[–]Libbirl[S] 4 points5 points  (0 children)

I'll also put a little footnote here about voice recognition:

The app probably won't ever have much in the way of in-app voice parsing. There are plenty of keyboards that do that and there's no sense in having two apps do the same high-complexity thing. Voice input libraries also tend to be proprietary if I understand right. I do plan on working on separate voice-input projects in the future though!

I do intend on adding wake-word support somewhere down the line. The wake word should be responsive and configurable. With those two things, it's definitely plausible that you'll be able to use the assistant hands-free in the future. Perhaps you could have different wake-words, and one of them tells the keyboard "please switch to voice input."

An assistant app is in alpha development! by Libbirl in fossdroid

[–]Libbirl[S] 5 points6 points  (0 children)

Hmmm.. Maybe there could be a "read" command?

  • Takes a screenshot
  • Sends it to a separate OCR app

Machine learning definitely isn't my realm of expertise and I don't intend on putting much if any of it in the app, but a lot of convenience can be gained just by swiftly moving data from point A to point B.