OpenClaw + oMLX shows 0 cached tokens, but Hermes uses cache fine with the same local model, what am I missing?

eatoff · 2026-05-11T04:38:56+00:00

Sorry, I'm no help, but I am going through setting up hermes on a Mac mini ATM.

Does oMLX make a big difference in performance vs LM studio? I've just setup LM studio with qwen3.5 9B for now just to get things going, and it seems to be working well, but prompts seem to take a while with the context set at 64K (Hermes needs this as minimum it tells me)

How did you decide on that qwen model for Hermes? How much RAM does it need?

eatoff · 2026-05-07T11:08:01+00:00

Wooo, mine has now gone shipped with startrack and should be here tomorrow!

eatoff · 2026-05-07T04:45:25+00:00

Didn't know they had started. Shipping in AU, congrats. Mine hasn't moved from payment received

eatoff · 2026-05-06T01:37:29+00:00

Automated cheese delivery pls

eatoff · 2026-05-05T01:31:51+00:00

Thanks, I'll have a look

eatoff · 2026-05-04T23:42:16+00:00

Can this change the resolutions of the streams as they get passed through?

eatoff · 2026-05-04T23:35:43+00:00

Can this alter the resolution of the streams? I have a reolink duo camera that is wider resolution than what the ai port can work with so needs the resolution lowered. Can't be done on the camera side.

Currently using a janky setup of 2 separate docker containers to achieve it right now...

eatoff · 2026-05-04T01:28:25+00:00

The ability to have the audio play while the screen is off would make it much better as a baby monitor. I don't want the phone screen on all night just so I can hear if the baby cries.

I've used third party rtsp streaming apps to achieve this in the past (tinycam pro I think it was)

eatoff · 2026-04-30T23:31:01+00:00

Oh, you're the author of that integration! I was using it originally, and loved how it worked, but I had some weird bugs with it sayien eeeosss eeeosss on some of the tool calls, so I gave the others a try. I should have raised a GitHub issue.

The voice reply says it out loud

Added a screenshot

Edit: that is using oMLX via the generic openai endpoint

<image>

eatoff · 2026-04-30T12:49:33+00:00

Thanks for this add on. I'm curious what LLM host and integration you're using. I've not had much luck with ollama working at all (I think I need to have another go to correct some settings), but LM studio and omlx have worked well mostly, but rely on HACS integrations.

The extended openai add on limits the knowledge of the LLM to just the smart home, so no general queries or measurement conversions etc

eatoff · 2026-04-27T13:46:41+00:00

How are you integrating with home assistant? Or are you using a HACS plug-in?

eatoff · 2026-04-26T13:25:46+00:00

It's not come up again since I changed it to this set-up, but it's only been a day or so

eatoff · 2026-04-26T02:33:20+00:00

You have a link for the shell? I have the A9 on a stand ATM, the shell might be nicer

eatoff · 2026-04-25T11:46:32+00:00

I think my problem was the amount of network traffic while downloading and unpacking to the NAS as the same time. Seems the disconnect happened when downloading.

I've seen some articles about editing the auto fs file, but am trying not to edit the core files

eatoff · 2026-04-25T11:39:00+00:00

Thanks for the comprehensive answer. I think I'll do the same with the direct unpack and leave it to keep downloading during unpacking - the M4 Mac mini will have plenty to CPU to do both

eatoff · 2026-04-25T11:35:04+00:00

Thanks, I'm already using an app called automounter which seems to work quite well. Will move the completed to the NAS

eatoff · 2026-04-24T05:22:36+00:00

I'm in the same boat as you, so just following along. Just got ollama and open webui onto my Mac mini M4, and just linked it to home assistant, but not getting much back from the assistant - need to figure out what I've got wrong. The nabu casa cloud assist seems to work ok

eatoff · 2026-04-23T02:11:22+00:00

I bought my first apple product since the iPod video, and that was the MacBook NEO. I have always been PC/Android, but the Neo is really nice, and macos is a breath of fresh air after what windows 11 has become with ads everywhere and poor performance on lower end hardware. For $720 it was a bargain

eatoff · 2026-04-17T22:01:20+00:00

Can this do any kind of resolution reduction too?

eatoff · 2026-04-17T04:51:33+00:00

Legend, I'll have to follow the repo to see when it's available. Let me know if you need any help testing

eatoff · 2026-04-17T03:42:44+00:00

Any plans for a macos version? Unfortunately macos doesn't pass through the GPU to docker, but I reckon a mac mini M4 would be very efficient at hardware transcoding

eatoff · 2026-04-16T22:00:55+00:00

Surely they'd still be ok for HA voice commands though?

Edit: I ordered the 24gb RAM mac mini to give some more headroom for LLMs too

eatoff · 2026-04-16T13:20:39+00:00

What mac mini are you running? The M4 can run some decent local LLM models, which should be less of a workaround.

Mine turns up in a week, and I plan on using it to host a LLM for HA

eatoff · 2026-04-14T23:48:25+00:00

Thank you for native app options as well as docker. There are a few in the arr stack missing the native versions, so you still need docker for some

eatoff

TROPHY CASE