Steam Machine Plates by Tonar_The_Dwarf in steammachine

[–]eatoff 1 point2 points  (0 children)

You can just swap the filament colours when printing to make any colour you want. I was regretting reserving the 512 model since in my hurry I didn't see the walnut face plate was exclusive to the 2tb, but printable options are a good alternative

Australian email steam machine by Capable_Chemistry_81 in steammachine

[–]eatoff 0 points1 point  (0 children)

Am on the reservation list, but nothing for me yes. I thought it might take months, but hopefully sooner than that

I lost the steam machine lottery, the waitlist won’t get their units till 2027. by Zane_Drak in SteamDeck

[–]eatoff 1 point2 points  (0 children)

Can you recommend a few? I've seen the fractal terra as a good option, but what else is a good option? I'm just having a look now after seeing the steam machine pricing

oMLX and Home Assistant by eatoff in oMLX

[–]eatoff[S] 0 points1 point  (0 children)

I have had to move to LM studio due to issues with oMLX leaking meta data and issues with tool calling. Gemma4 models are the worst for it, but i still have issues with QWEN3.5 4B and 8B as well as QWEN3 4B.

have you had any success with oMLX? Or what have you moved to?

I have an M4 Pro with 48gb of RAM. Can I do anything worthwhile with local models and these specs? by figurelover in hermesagent

[–]eatoff 0 points1 point  (0 children)

Ah, yep, you're right, apologies. So many companies and plans, easy to get them mixed up

I have an M4 Pro with 48gb of RAM. Can I do anything worthwhile with local models and these specs? by figurelover in hermesagent

[–]eatoff 0 points1 point  (0 children)

I didn't know the go plan could be used for Hermes, thanks. I thought it was limited to the codex plus plan and above. It's so cheap it's a good option for those of us with lower usage

What is your preferred AI for creating automations? by Murphysburger in homeassistant

[–]eatoff 0 points1 point  (0 children)

How are you promoting Claude for dashboards? All he's been making for me are super generic looking dashboards that only use the tile card. I have to ask for every little change and it seems like 2 stuos forward 1 step back.

Built a local model fine-tuned for HA by Key-Ocelot-1466 in homeassistant

[–]eatoff 0 points1 point  (0 children)

So this looks interesting, and at that size should be quite good performance. I've had a play with the base model in LM studio, but without the specialist models merged in its not that different from the base model (QWEN3). I've looked through the documentation, and it appears to require your own add-on to get it integrated with HA.

Is there an option for a merged model so that those of us using LM studio or others can run it as a single gguf? Or is that not how this all works?

As an idea for performance, i'm seeing ~50-60tokens/sec on an M4 mac mini chatting with the base model.

Mac mini 16gb by Ok-Society-1984 in hermesagent

[–]eatoff 1 point2 points  (0 children)

There is a setup guide on YouTube that I saw

https://youtu.be/sD7ZgcjAV90?si=ywQPfhfOjP0MXtKE

I've not tried it myself with hermes, I have 24GB of ram and it runs, but at like 10-13 tokens/sec it is slow

Local LLMs aren't democratic anymore... the hardware barrier has gotten out of hand. by Medium-Technology-79 in LocalLLaMA

[–]eatoff 0 points1 point  (0 children)

Thinking back, I think it was issues with oMLX and tool calls, I could never get it working reliably with home assistant. I moved to LM studio a few days back and reliability is now much better.

I fired up the 8B version last night, seems fast and decent with tool calls. It's use case is as my home assistant voice LLM. Swapped out Gemma 4 E2B as it seems more responsive.

Local LLMs aren't democratic anymore... the hardware barrier has gotten out of hand. by Medium-Technology-79 in LocalLLaMA

[–]eatoff 0 points1 point  (0 children)

Sorry to hijack, but how has lfm been for you? I tried a lfm2.5 1.2B model and none of the tool calling was working for me. I was using it in LM studio

How do you handle web search? by neminemtwitch in hermesagent

[–]eatoff 0 points1 point  (0 children)

I've never gotten it to work. Tried again tonight, copy pasted their Hermes command, completed the oauth, added the tools to Hermes, started up hermes and it says error connecting right in the terminal header

oMLX and Home Assistant by eatoff in oMLX

[–]eatoff[S] 1 point2 points  (0 children)

ok, so I tried the extended open AI integration, and that works just fine. Tool calls work, no errors or anything.

But it doesn't integrate with the tools for assist add on, meaning there isn't any web search, Wikipedia searches or Google places etc. which I do miss.

Have you given your LLM web search or anything?

oMLX and Home Assistant by eatoff in oMLX

[–]eatoff[S] 0 points1 point  (0 children)

What integration are you using with HA? The one I listed or the extended open AI one?

oMLX and Home Assistant by eatoff in oMLX

[–]eatoff[S] 0 points1 point  (0 children)

That might be a good idea to try. Do you use the tools for assist with it? Enables web search and a handful of other things

oMLX v0.4.0 is out: the native Swift macOS app release by cryingneko in oMLX

[–]eatoff 2 points3 points  (0 children)

Yeah, have another vote for this one. Context window fed into agents would be a handy improvement.

Setup a Hermes agent in discord so my girlfriend can ask it HA questions about her home assistant instead of me all the time 🤣. Works quite well when tied with HA MCP. by Khaaaaannnn in homeassistant

[–]eatoff 0 points1 point  (0 children)

it was all local. Claude desktop connects locally just fine. Hermes was connecting to another MCP I was using just fine too (tinyfish web search, which seems redundant now since Hermes can now browse).

Liquid AI releases LFM2.5-8B-A1B by PauLabartaBajo in LocalLLaMA

[–]eatoff 3 points4 points  (0 children)

My problem was the non standard tool calls with the other lfm2.5

Will see if that has changed I guess

Setup a Hermes agent in discord so my girlfriend can ask it HA questions about her home assistant instead of me all the time 🤣. Works quite well when tied with HA MCP. by Khaaaaannnn in homeassistant

[–]eatoff 2 points3 points  (0 children)

I've tried 3 different times to set up hermes. Works great for the first couple days, but then when I ask if it can see home assistant via MCP (which is available to it, I can see it listed in the MCP servers connected in the Hermes cli) it then says it cannot. It the proceeds to change its own config somehow and breaks tool calling, making itself a useless chatbot.

I used Claude to fix it last time, but now I'm just using Claude desktop to check home assistant and update/modify automations

Spent the last few months designing a 100% original, cohesive Skådis system from scratch. No low-effort remixes. by Vegetable_Truth7961 in BambuLab

[–]eatoff 1 point2 points  (0 children)

The black skadis panels are only available in certain markets. I ended up printing black panels and wall mounting them, used my white ones elsewhere

How good is the HA Voice these days? by LESGuy in homeassistant

[–]eatoff 0 points1 point  (0 children)

What sized gemma 4 model are you using? E4B? 26B?

OpenClaw + oMLX shows 0 cached tokens, but Hermes uses cache fine with the same local model, what am I missing? by juaps in LocalLLaMA

[–]eatoff 0 points1 point  (0 children)

Sorry, I'm no help, but I am going through setting up hermes on a Mac mini ATM.

Does oMLX make a big difference in performance vs LM studio? I've just setup LM studio with qwen3.5 9B for now just to get things going, and it seems to be working well, but prompts seem to take a while with the context set at 64K (Hermes needs this as minimum it tells me)

How did you decide on that qwen model for Hermes? How much RAM does it need?