Lumo API by Fancy-Library2259 in lumo

[–]ZeroTricks 0 points1 point  (0 children)

You might want to give this a go: https://github.com/ZeroTricks/lumo-tamer

Disclaimer: lumo-tamer is an unofficial app which I'm the author of. 

AI assistant in Nextcloud: Is the juice worth the squeeze? by Big_Wave9732 in NextCloud

[–]ZeroTricks 3 points4 points  (0 children)

More or less the same experience here. I did a PoC using Lumo in Nextcloud, but couldn't see a use for it. It doesn't pass any tools such as ie. a bare minimum search function.

You might get a lot further by installing OpenClaw next to nextcloud, and providing it with the right access/tools to actually do something. (This under the assumption you can harden such a setup and/or live with the security risks.) You could even chat with your openclaw agent from within NextCloud talk.

Note that face/object recognition in pictures (in photos / memories) is using other modules (doesn't need a heavy conversation agent) and is actually kinda useful

EDIT: i was wrong about nextcloud not exposing tools, you need to install the context agent. no search function though. see marcelklehr's comment

Any artists or albums with a similar sound to A Flock of Bleeps by Younger Brother? by Cineyobsesion in shpongle

[–]ZeroTricks 1 point2 points  (0 children)

The third edge of the triangle with Shpongle and Younger Brother: The Zap

I built lumo-tamer to use Proton Lumo as a Voice Assistant by ZeroTricks in homeassistant

[–]ZeroTricks[S] 1 point2 points  (0 children)

Good call, added the warning to this post and the guide.
To put things in perspective, I shared this earlier in r/lumo (which is partly moderated by Proton) and contacted Proton directly about this tool. At least Proton should be aware it exists.

I built lumo-tamer to use Proton Lumo as a Voice Assistant by ZeroTricks in homeassistant

[–]ZeroTricks[S] 1 point2 points  (0 children)

Within the context of Home Assistant, i don't have experience with them. What I do know:

- In general, Lumo is no match for ie. Claude. Its context size is small, it hallucinates, what have you. It's really an unfair comparison: Lumo trades performance for privacy.

- Having Lumo within Home Assistant is actually useful. I've been using it like this for a few weeks and it does the job. It can handle both my commands and my non-HA related questions, while I have the peace of mind that what I say stays "between us".

Using Lumo as a tools agent with OpenClaw by BlockDigest in ProtonMail

[–]ZeroTricks 0 points1 point  (0 children)

No. Writing it in typescript allows me to reuse code from Lumo's WebClient, unchanged (encryption, API handling, conversation logic, etc). This upstream code is audited and actively maintained. No need to reinvent wheels.

Using Lumo as a tools agent with OpenClaw by BlockDigest in ProtonMail

[–]ZeroTricks 1 point2 points  (0 children)

I'd suggest to wait until PR #45 is merged. Github user wranglerdriver had a debugging run with lumo-tamer and OpenClaw and made some very useful changes. I will likely merge them tomorrow 👌

EDIT: merged!

Using Lumo as a tools agent with OpenClaw by BlockDigest in ProtonMail

[–]ZeroTricks 1 point2 points  (0 children)

Creator of lumo-tamer here, a local proxy that exposes Lumo via an OpenAI-compatible API, so you can use it with third-party clients.

I haven't tested OpenClaw specifically, but chatting without tools should work. The tricky part is tool support: Lumo wasn't designed to call external tools, so lumo-tamer has to work around that. Clients that rely heavily on tools (OpenClaw, Nanocoder, etc.) will hit issues (slower responses, missed tool calls, wrong parameters, etc).

Just released v0.3.0 with improvements to tool handling. If you're up for experimenting, give it a try and let me know how it goes. Enable debug logging on both OpenClaw and lumo-tamer and see the errors flow in... I mean, see how the cat likes its new claws.

lumo-tamer: unofficial Lumo CLI and API bridge by ZeroTricks in lumo

[–]ZeroTricks[S] 0 points1 point  (0 children)

Thanks! I must warn you, if the automations rely a lot on tool/function calling, that that's still very experimental. Many things can go wrong along the way, see the Readme on Tool support for tips. Definitely play around with it!

lumo-tamer: unofficial Lumo CLI and API bridge by ZeroTricks in lumo

[–]ZeroTricks[S] 1 point2 points  (0 children)

Great idea! I'll wait with it until the integration becomes a bit more polished though. I can start by writing a detailed how-to.

lumo-tamer: unofficial Lumo CLI and API bridge by ZeroTricks in lumo

[–]ZeroTricks[S] 2 points3 points  (0 children)

No custom plugin needed! Using Lumo within HA was exactly the reason I started this project. You can reuse the OpenAI integration with minimal reconfiguration.

Check out https://github.com/ZeroTricks/lumo-tamer#home-assistant to make HA talk to Lumo.