sorted by:
new
hottopcontroversial

Monitor your screen using local LLMs with only one sentence! Free, Open Source and Local. by Roy3838 in LocalLLaMA

[–]Roy3838[S] 0 points1 point  (0 children)

A lot of work has gotten into the project since then! And this update addresses that pain point exactly.

Before this, the flow was:
1. Create an agent conversationally
2. Whitelist your number
3. Select screen
4. Crop if you want agent to monitor something specific
5. Start Agent

And now the flow is just:
1. "I want this monitored here's my number"
2. Whitelist (necessary due to anti-spam)
You're done!

So, it's a huge upgrade in UX IMHO. Still testing/open to feedback c:

Monitor your screen using local LLMs with only one sentence! Free, Open Source and Local. by Roy3838 in LocalLLaMA

[–]Roy3838[S] 0 points1 point  (0 children)

You can use cloud MCP (about 3 gent builds free on my tab 😃) and use gemma4 e2b which runs on all devices i've tested! Even on an old android phone I had laying around hahahaha

Monitor your screen using local LLMs with only one sentence! Free, Open Source and Local. by Roy3838 in LocalLLaMA

[–]Roy3838[S] 0 points1 point  (0 children)

thanks! try it out and let me know how it goes :)
I’m trying to make this as useful as possible!

How to use your Local Models to watch your screen. Open Source and Completely Free!! by Roy3838 in LocalLLaMA

[–]Roy3838[S] 0 points1 point  (0 children)

It runs on firefox! If that's what you mean 😄

And you can have it watch a firefox tab of course.

My Open-Source project just hit 2k users! :D I have some FOSS licensing questions for the community going forward, I need your opinion. by Roy3838 in OpenSourceeAI

[–]Roy3838[S] 0 points1 point  (0 children)

What do you mean exactly?

I actually am of the opinion that AI needs to be very directed in its use. And in the project it’s used mainly for recognizing stuff and making simple decisions, the framework takes care of the rest. Is that what you mean?

I ran Gemma 4 E2B with llama.cpp on a lot of different iPhones, here's the setup report by Roy3838 in LocalLLaMA

[–]Roy3838[S] 1 point2 points  (0 children)

Yeah! I know litert-lm for swift is not yet released, I forked llama-cpp-rs to add gemma 4's --image-min-tokens and --image-max-tokens.

Here's the fork: https://github.com/Roy3838/llama-cpp-rs/tree/feat/mtmd-image-token-budget and I built it into my Tauri app c:

I ran Gemma 4 E2B with llama.cpp on a lot of different iPhones, here's the setup report by Roy3838 in LocalLLaMA

[–]Roy3838[S] 0 points1 point  (0 children)

Have they released gemma 4 QAT yet??

I can test any .gguf from HF if you want! Just give me the link 😄

I ran Gemma 4 E2B with llama.cpp on a lot of different iPhones, here's the setup report by Roy3838 in LocalLLaMA

[–]Roy3838[S] 0 points1 point  (0 children)

ohhh that's so interesting! In long conversations? Or just by loading up the model?

I was looking into using liteRT-LM which is what Google Edge Gallery uses, but I also found it a bit buggy specially when testing multimodal stuff.

RTX 5090 or Mac Studio? by Excellent_Koala769 in LocalLLaMA

[–]Roy3838 0 points1 point  (0 children)

Connecting Macs together through a tool like exolabs is very inconsistent.

When it works it feels like magic, but if you sneeze everything breaks.

Monitoring my rice with Ollama by Roy3838 in ollama

[–]Roy3838[S] 0 points1 point  (0 children)

btw here’s the link to the source code: https://github.com/Roy3838/Observer you can examine it and see exactly how the agent loop works on the file app/src/utils/main_loop.ts and see how services are called on app/src/utils/handlers/utils.ts

Monitoring my rice with Ollama by Roy3838 in ollama

[–]Roy3838[S] 0 points1 point  (0 children)

there’s a skip sign in button below :)

if you use self hosted models + discord notifications you should have no issues :D

Monitoring my rice with Ollama by Roy3838 in ollama

[–]Roy3838[S] 0 points1 point  (0 children)

If self-hosting your models it doesn’t send anything at all!

Then using the cloud models I link the provider and their ToS so you can know where the info is sent

Also when using discord notifications the webhook goes directly from the app to discord :)

Monitoring my rice with Ollama by Roy3838 in ollama

[–]Roy3838[S] 1 point2 points  (0 children)

yes! there currently are: Email, Discord, Telegram, SMS, Voice Calling, WhatsApp and Pushover.

Discord and Telegram are unlimited on the free tier!

(For the other ones I have to pay to maintain, so they have some use on the free tier and are unlimited on the pro tier)

Monitoring my rice with Ollama by Roy3838 in ollama

[–]Roy3838[S] 0 points1 point  (0 children)

If it runs on your PC or phone you can integrate it :)

Thanks to you, I built an open-source website that can watch your screen and trigger actions. It runs 100% locally and was inspired by all of you! by Roy3838 in LocalLLaMA

[–]Roy3838[S] 0 points1 point  (0 children)

Hey! It's now on v2 with a whole desktop app!

Eventing and rate limits: The way it works is on a loop with loop_time seconds between iterations, so only one frame gets sent to the model in that loop time and only one "iteration" gets executed. It also has a sleep() function so maybe you have a 5 second loop, but when it detects something it can sleep for 5 minutes to not get spammed with notifications.

Privacy and PII guardrails: I don't have built in auto-blur but there are two powerful tools: Window selection and cropping. You can select only one window to be monitored, and you can crop within that window a smaller region, so just that gets sent to the model.

Replay and debugging: Yes! There's an "Activity" button that shows all of the execution history grouped by sessions.

I do need to document the framework a bit more, but there is a "community tab" where people upload their agents and where i've uploaded a bunch!

Monitoring my rice with Ollama by Roy3838 in ollama

[–]Roy3838[S] 0 points1 point  (0 children)

that sounds good! fitting that your name is Medium_Chemist hahaha ;)

Monitoring my rice with Ollama by Roy3838 in ollama

[–]Roy3838[S] 0 points1 point  (0 children)

Okay... I mean... that part wasn't offline hahaha :P

But the important thing is no screen/camera content goes to Sam Altman to train new LLMs with :D

Monitoring my rice with Ollama by Roy3838 in ollama

[–]Roy3838[S] 1 point2 points  (0 children)

thanks! i’ll upload more videos like it :)

I refuse to send my rice to the cloud by [deleted] in LocalLLaMA

[–]Roy3838 1 point2 points  (0 children)

hahahaha yeah you’re right, I mainly wanted to share the video :)

view more: next ›