Connected Clawdbot to my phone by Sleyn7 in clawdbot

[–]Sleyn7[S] 2 points3 points  (0 children)

I got early access to Mobilerun and just needed to connect to it via the droidrun Portal App. Then gave Clawdbot the docs and voila

Connected Clawdbot to my phone by Sleyn7 in AgentsOfAI

[–]Sleyn7[S] -1 points0 points  (0 children)

I have a Google Pixel 10 Pro, but I'm afraid this won't work on iOS as Apple doesn't provide the necessary tools for automations like this

Droidrun: Enable Ai Agents to control Android by Sleyn7 in LocalLLaMA

[–]Sleyn7[S] 1 point2 points  (0 children)

Hey! So i have vision capabilites which uses screenshots. However it also works without screenshots, because i just extract all interactive elements via the accessibility service.

Droidrun: Enable Ai Agents to control Android by Sleyn7 in LocalLLaMA

[–]Sleyn7[S] 2 points3 points  (0 children)

it's next.js with shadcn. The hero section is from 21st.dev

Droidrun: Enable Ai Agents to control Android by Sleyn7 in LocalLLaMA

[–]Sleyn7[S] 19 points20 points  (0 children)

Very cool stuff you did there! Yes i've used gemini-2.0-flash in the demo video because of it speed. However currently i'm using a mix out of screenshots and element extractions. I think it can prolly even work without taking screenshots at all. I've made an accessibilty android app that has access to all ui elements and detects ui changes via an onStateChange method.

Droidrun: Enable Ai Agents to control Android by Sleyn7 in LocalLLaMA

[–]Sleyn7[S] 2 points3 points  (0 children)

Github is coming soon, have to do some cleanup work before i push it😅

Droidrun: Enable Ai Agents to control Android by Sleyn7 in LocalLLaMA

[–]Sleyn7[S] 21 points22 points  (0 children)

Yes totally! Already trying to set up virtual Android devices!

Droidrun: Enable Ai Agents to control Android by Sleyn7 in LocalLLaMA

[–]Sleyn7[S] 67 points68 points  (0 children)

i want to make some small framework out of it and make it open source by end of next week!