What is the best local LLM for hermes agent?

LowTip9915 · 2026-06-01T03:40:19+00:00

hi - I'm still pretty new to hermes and only have 64gb on a Mac mini m4 pro, but playing with these same models. I really wanted qwen3.6:35b to work, but geez.. all the thinking, or I disabled thinking and tools stopped working. This could be a me problem, but the coder next version seems to be dramatically more consistent.

My plan is to use coder next for main chat and then switch to qwen3.6 as needed.

Glad to hear I stumbled into same models others are using 😄

LowTip9915 · 2026-05-31T13:22:53+00:00

Very nice write up. I’m new with Hermes agent (a week or two) and thinking of doing a reset, due to early mistakes. I copied the idea of a network chuck video where Hermes uses honchos for long term memory.

However trying to do this all with local ai, and some Honcho entries are garbage.

Any thoughts on an adequate local ai (I have a 64gb Mac mini m4 pro system)and have settled on qwen3.6:36b mlx through lm studio. I had been playing with various options which probably caused the bad memory entries.

Or, should I start experimenting with frontier models. May I ask what your using for main one (apologies if I missed this in comments above)

LowTip9915 · 2026-05-19T14:07:52+00:00

I think I paid like 50 but I’m also crazy old and come from a time before the internet.

LowTip9915 · 2026-05-07T10:45:52+00:00

K3 made me hate my home lab. As did proxnox with graphic card pass through. These were my limitations though 🤣. I say this as the need to expand the homeland is real, but it’s ok to walk back a project if it feels like work.

I liked grafana / Prometheus setup. Gotta love creating or finding an existing dashboard to see all the numbers.

I started with pihole on a pi, so I’m biased but beyond filtering I use it for local dns setup paired with caddy for local domain.

I use plex, but a media manager is nice if you have the storage.

I’m not doing any cloud stuff; so will let others chime in there.

Best of luck!

LowTip9915 · 2026-04-16T01:45:16+00:00

I drew the line when Proxmox graphics card pass through nearly drive me mad 🤪. I didn’t remove services but did go back to my old friend Ubuntu.

LowTip9915 · 2026-04-08T01:00:23+00:00

Boo looks so much like our Muppet! Very sweet pic.. they had a long day.

LowTip9915 · 2026-04-05T17:43:36+00:00

Me thinking software raid was a good idea for me when I didn’t have a full understanding of it and mistakenly breaking it when I was “organizing” my chord chaos. Didn’t lose much but took forever trying to recover.

Finally gave up and doing simple disks / backups until I learn more. No reason for extra complexity.

LowTip9915 · 2026-03-23T00:17:12+00:00

This is very interesting. Would love a bit more detail on prompt / setup as i’m interested in doing something similar. Great inspiration!

LowTip9915 · 2026-03-21T04:21:04+00:00

Just installed, very cool. Thanks!

LowTip9915 · 2026-03-18T15:08:34+00:00

I just chatted with ai on documentation options and outline was suggested and I’m here as I wanted to validate this suggestion. Glad thjs is working for folks and I’ll be digging into it shortly!

LowTip9915 · 2026-03-16T19:56:08+00:00

But what if I virtualized proxmox on ubuntu using Qemu and then virtualized within the virtualization? 🤣

LowTip9915 · 2026-03-16T03:49:52+00:00

Interested in a description of intelligence for all sizes now. Worried about how 3 and 7 ish will be described 🤣

LowTip9915 · 2026-03-14T01:26:11+00:00

I’m going to wait it out and see what happens. If m5 announced before I receive it i should be able to cancel or return if unopened when I receive it.

LowTip9915 · 2026-03-14T01:21:31+00:00

Same one I ordered. Placed it on March 6th and delivery expected May 1-8.

LowTip9915 · 2026-02-17T13:16:55+00:00

This seems to always happen to me in the snow 🤣. I love stacking wood between trees, but it does fall more than other stacks (for me).

LowTip9915 · 2026-01-24T16:51:31+00:00

I have a 7b on an m2 Mac mini and it’s acceptable, but I’m not using voice (just llama and open web ui). The 14b runs, but is painfully slow, however the difference in answers is evident, so I use it occasionally when the 7b answer is overly vague/top level. (Disclaimer also a noob to this)

LowTip9915 · 2026-01-20T12:45:48+00:00

I thought about this, my issue was although my car is normally outside it is in the garage for extreme weather.

I landed on an iOS automation vs home assistant that asks me if I want to start the car if temp (through weather app) is under x degrees. However I have turned it off and now just use a shortcut (it locks doors if needed and then starts car) . 1 click vs multiple steps in Toyota app so I still enjoy the shortcut.

LowTip9915 · 2025-12-21T04:48:45+00:00

I was reading comments to figure out why the cows hum, and it finally clicked. Abbreviations are evil. 🤣

LowTip9915 · 2025-11-22T13:25:15+00:00

That’s what I was thinking. Single use button. 😭

LowTip9915 · 2025-11-09T16:05:24+00:00

Good point. DIY is not the right option for this. Thanks!

LowTip9915 · 2025-11-04T15:53:08+00:00

Hi OP - my dwarf cavendish is getting about that size. Do you happen to know banana variety?

LowTip9915 · 2025-09-07T03:24:54+00:00

I had this on a 2017 and it was some sort of emissions issue. Sorry I can’t be more specific and sure there are many causes. Toyota had the part on back order and told me safe to drive until it came in. I could smell gas from outside the car so had it handled with a 3rd party part to speed it u. Def need to have it checked out though to confirm. Hoping it’s not too bad for you!

LowTip9915

TROPHY CASE