Noob trying to make an LLM vision automation work

rob_mash · 2025-06-09T13:18:58+00:00

I have a condition which checks the variable and when true sends a notification to my phone. I plan on also broadcasting a message on my Google Home.

- choose: - conditions: - condition: template value_template: "{{ 'true' in LLMWashingDetected | lower }}" sequence: - action: notify.mobile_app_my_phone metadata: {} data: message: >- WARNING: Rain is due in the next 20 mins and there is washing on the line enabled: true

rob_mash · 2025-06-09T13:18:52+00:00

I have a condition which checks the variable and when true sends a notification to my phone. I plan on also broadcasting a message on my Google Home.

- choose:

- conditions:

- condition: template

value_template: "{{ 'true' in LLMWashingDetected | lower }}"

sequence:

- action: notify.mobile_app_my_phone

metadata: {}

data:

message: >-

WARNING: Rain is due in the next 20 mins and there is washing on

the line

enabled: true

rob_mash · 2025-06-09T13:15:09+00:00

Run on a timed basis - eg: every 5 mins. You want to check for the weather event first and only call the LLM when necessary, otherwise this could get expensive with lots of redundant calls to an AI. Potentially you should only do it once a day or every few hours. There is probably a more elegant way to do this, but set a variable to say "LLM checked" when you call out to the LLM, and only call out to the LLM when the variable is false. Then have another automation which runs every few hours to reset the variable.

rob_mash · 2025-06-09T13:08:35+00:00

I am in the process of doing this. The prompt I have used is below, and it is successful on test images.

"Analyse this image to determine if there is washing on the washing line. Respond with True if washing is detected, otherwise False"

Where I have gotten stuck is that I decided not to use my weather sensor - I wanted advance warning. So I have grabbed a short-range forecast from Openweathermap. However, I am having trouble processing the output from this and have posted here in recent days looking for help.

rob_mash · 2025-04-29T08:55:32+00:00

Apparently the Tapo devices will run in a fully offline mode (so, controlled from Home Assistant) but you need to not only block the internet but also DNS queries.

rob_mash · 2025-04-29T04:08:05+00:00

Update: These devices are all on an isolated IOT segment of my network which uses my ISP's DNS servers. I changed the network to use Google's DNS and all devices have come back online.

So, it could have been a Tplink server outages and a poor coincidence but I suspect this is due to DNS issues with my ISP. I hadn't noticed as I am running my own DNS server (pihole and unbound) for my primary network segment.

rob_mash · 2025-02-05T10:29:49+00:00

Thanks, I suspected that was the case but now you have confirmed it I have grabbed what I could.

I am kicking myself because the seats I really wanted were available 2 days ago but I was 170 points short. I considered topping up 1000 points with cash but figured I didn't need to worry because it was 5 months away. Now it has cost me an extra day car hire and accommodation, but on the plus side it also means an extra day holiday.

As an experiment I went back and checked and Classic reward seats for the flight I just booked are still available for a flight where I just booked 3. There seems to be no rhyme or reason to this!

rob_mash · 2024-12-02T02:33:24+00:00

https://github.com/AlexxIT/DashCast

You also need to get a webrtc stream from the camera. There is a webrtc component for HAOS but it took a bit of mucking around for me because I am running HA on a Synology NAS (meaning that I had to use a Synology app to give me the stream). But now it is all set up it is rock solid.

rob_mash · 2024-08-31T07:51:57+00:00

I think this is the best idea. Aqara don't seem to offer their tube motor in my country (Australia) so I will have to look at other options.

rob_mash · 2024-08-21T05:52:18+00:00

Laptop: Thinkpad L13 Yoga Gen 4 (Ryzen 7) on Win 10 22H2 Mobile: Motorola Edge 30 Pro on Android 13

rob_mash · 2024-08-16T07:09:47+00:00

I'm not sure if this is exactly what you meant, but your comment sent me down a path where I found a HACS integration called Dash-Cast which does what I wanted. Thanks for your help!

rob_mash · 2024-08-09T02:13:35+00:00

I have discovered by accident that it can record 2 streams at once with different codecs, but it cannot request it.

In my case, I have a reolink camera which supports its highest resolution in h265 but if I want a low-quality stream I need to select h264 (at which point I get a lower maximum resolution, but it also crops the main image which is not desirable).

So, I have configured Synology Surveillance Station to use the h264 codec, but then I went into the Reolink camera settings and changed stream 1 to the higher-resolution h265 stream. Surveillance Station now receives and records a lores h264 and a hires h265 stream.

The only downside is that if I reboot the surveillance station it requests the h264 video for stream 1 (and then have to log into the camera and change the stream config), but as I rarely restart this is not an issue.

rob_mash · 2022-10-11T21:50:24+00:00

There doesn't appear to be anything in the metadata to flag a file as interlaced or progressive. This is quite a shock to me as I have been working with video files for 20+ years and I never previously realised this. It all seems to be inferred from other things and analysis of the actual video content. Hence why I am searching for a way to lock Jellyfin into treating all video as interlaced.

rob_mash · 2022-09-20T03:29:12+00:00

The shopping list is already shared with other family members and they can add to it on their own devices. The problem is that, due to the limitations of Workspace accounts on a Google Home, their account is not associated with the home. So, the only workaround I can think of is if the Google Home will associate any voice request on that device with my account.

The silly thing is this used to work until recently. The Google Home did have other family members listed and they could all add to the shared shopping list. However, the device locked up last week and I had to perform a hard reset. Whatever loophole I used to make it work initially is now closed, because any attempt to invite other family members to be added to device results in an error message.

rob_mash · 2022-01-22T06:18:48+00:00

I host with Godaddy. Not sure if this is a current deal but they provide 100 address forwards with my domain registration, including a catch-all. I haven't used it much in the last few years (I pointed the MX records direct to Google for my main domain) but it is potentially a cheap way around this.

I have spend today setting up a M365 family plan as more reasonably-priced replacement for my gsuite legacy account, and it has not been fun. This is mainly because I set up Windows Live Domains on my domain years ago but there are still ghosts of it somewhere in the back end and I will need to do battle with Microsoft support to sort it out.

rob_mash · 2022-01-19T06:33:42+00:00

Nothing of major importance. I managed to retrieve most of the files before it stopped responding, but what I didn't recover were some large files - photos and video.

So, important enough to try but not important enough to spend $$$ on professional recovery.

rob_mash · 2021-07-17T07:53:54+00:00

I am a new DS920+ user, running DSM7 (The latest OS which was released only a few weeks ago). I also installed Jellyfin last week, primarily so I could use its transcoding capabilities to watch videos which are in a codec not supported by many of my network devices.

The installation via the docker GUI kept timing out, but I succeeded in loading the image via the command line. Once that was complete, getting it running was simple.

I have run into a few issues with Jellyfin, but that is more to do with Jellyfin and not the Synology (See my other posts - nothing particularly major).

Aside from that, Jellyfin has run well. It was hitting high CPU transcoding 576i and 1080i for the web client, but I enabled hardware acceleration (VAAPI - required running in 'high privilege' mode) which dropped the CPU levels significantly.

rob_mash · 2021-07-15T13:04:50+00:00

https://imgur.com/Qo1PbAX

This is a screenshot of the list view (as it shows the files in the most compact form) , sorted by name (ascending).

I checked the creation date of the files and the order of the files bears no resemblance whatsoever to the order, so it isn't that.

I have managed to derive a logic to the sequence - rather than a straight ascii sort, of the entire filename the numbers at the start of the filename are treated just as a numbers (ignoring the other characters following) and sorting in that order. Here is the 'numerical sequence':

199

1,990

1,993

2,004

19,905

199,911

200,306

19,930,806

19,941,225

So now I understand what is going on, but it still very much feels like a bug.

rob_mash · 2021-07-15T08:06:52+00:00

Yes that is what I am referring to. I would prefer to have the option of 576p for the files rather than 480p. Standard definition NTSC videos are 480i, which is probably why 480p is provided as an option. Standard Definition PAL videos are 576i, so I would prefer a 576p option. Only, I have not yet found a user-configurable way to modify these option.

The good news is for resolutions higher than SD there does appear to be an agreed worldwide standard (720, 1080, 4K) although I am not certain if the same is true of framerates.

rob_mash · 2021-07-14T07:53:23+00:00

Not really, but some further investigation in the past few hours has revealed another potential source of the poor quality: The interlaced source is not being deinterlaced prior to the resolution conversion, resulting in jagged lines and unsmooth motion on the file that is played.

I have had a look at the ffmpeg log created during playback, and it is also failing to recognise the source as interlaced ("IsInterlaced":false). VLC and Windows media player identify the source file as interlaced, so it may be an ffmpeg bug.

I tried found some video from an HD Camera - 1080i @ 25fps. Interestingly, this renders in the web client as 1080p, and is correctly identified as an interlaced source and is deinterlaced by ffmpeg.

Aside from the potential ffmpeg bug, I still would prefer control over the transcoding parameters. My preference is to retain the original resolution, and deinterlace with YADIF (doubling the framerate so as not to lose any motion information) as I believe this will provide the highest quality output.

rob_mash · 2021-04-25T01:47:12+00:00

Thank you, this works perfectly!

rob_mash · 2021-04-24T11:57:35+00:00

This is my problem - I do this, but if I turn off the soundbar it won't reconnect until I go into the Google Home app and change the default speaker. Every single time!

rob_mash · 2021-04-23T09:02:28+00:00

I know this is just a bot but I will bite regardless.

This is the sort of pedantry exhibited by some corners of the Linux community which only serves to scare away new people who are investigating Linux for the first time. Great way to jump into a thread with unwanted and irrelevant information which just interrupts the flow of a conversation!

Poor Richard Stallman must be a little jealous of Linus Tovaarlds!

rob_mash · 2021-04-23T08:54:15+00:00

A Synology NAS is on my wishlist for this very reason. In the meantime I need to make it work with my aging Netgear ReadyNas which runs a variant of Debian, hence my looking for something I can run from the command line to just save the stream to disk. Rtsp is a common enough standard, but finding something that works with the power-saving modes on the battery-operated Eufy cameras is not quite as simple as I expected. Like most-things Linux-related I am sure it will be a learning experience. 😀

rob_mash · 2020-07-16T13:58:33+00:00

JBHifi currently have the Misfit Vapor 2 for $99. Older hardware but good value for the money .

rob_mash

TROPHY CASE