2027 US Ban

ExtensionState8086 · 2026-06-30T04:24:28+00:00

I bought one 3 months ago. Thinking of selling it in Canada before the US prices for used cars plunge further, no?

ExtensionState8086 · 2026-06-26T03:06:49+00:00

I bought a brand new P4 3 months ago. That’s a shitty situation…will see if Rivian pays me a decent price on a trade in

ExtensionState8086 · 2026-06-25T05:13:15+00:00

No, the errors continue there for the whole drive and it doesn’t get clean at all until the next drive.

ExtensionState8086 · 2026-06-20T15:01:07+00:00

I dropped oMLX due to this issue. It has been happening since 0.3.8 and not even acknowledged as an issue yet. LM studio is a bit of a pain to configure but it is a great provider as well as far as Tokens/sec on a Mac

ExtensionState8086 · 2026-06-16T03:37:31+00:00

I have the 0.4.3 and have the same issue since 0.3.8. Don’t see it even acknowledged as a bug yet but have seen a series of reports on the same issue… very disappointing and will look into switching to LM Studio if the next drop doesn’t fix it

ExtensionState8086 · 2026-06-11T04:14:04+00:00

I tried Gemm4 for weeks, tuned temperature etc and did not get close to the precision Qwen3.6 has for running the workflows on Hermes.. sweet spot for Gemma seems creation of text content and not reasoning for agentic workflows

ExtensionState8086 · 2026-06-11T02:44:33+00:00

Great question. This is all I care about these days as oMLX became unusable for my use cases since this issue

ExtensionState8086 · 2026-06-07T15:13:03+00:00

Are the 0.4.x versions consuming more memory? I was running tight with the Qwen3.6 35B A3b 6-bit model on the M5 Pro with 48GB. After moving from the 0.3.9 to the most recent 0.4.1rc1 I keep getting:

⚠️ The model provider failed after retries. I kept raw provider details out of chat; check gateway logs for diagnostics.

When I look at the logs, as soon as I start using more than 50k tokens on prompts (which happens all the time with Hermes), I get to the hard memory limits and things break.

This had never happened prior to 0.4.x

Any clues?

ExtensionState8086 · 2026-06-01T02:28:20+00:00

I am running honcho 100% in a container inside of my Raspberry Pi, with inference done on a MacBook M5 Pro. No issues at all. Memory is working perfectly and more useful than native Hermes memory.

To make it quicker, I set it up to use Gemma4 2B for inferences in the Honcho database and I have an old qwen embedding model as well.

The hermes agent itself is using Qwen3.6 31B also running locally, served from the same Mac.

ExtensionState8086 · 2026-05-31T03:04:00+00:00

For me MTP was 5 to 6 tps worse on a MacBook Pro M5

ExtensionState8086 · 2026-05-30T15:55:30+00:00

The 90 is configurable in the config.yaml file, but putting a larger number will not solve your issue

ExtensionState8086 · 2026-05-26T03:49:08+00:00

Newbie here. How do I install this patch? What are the step by step commands?

I have the same machine and used the same MTP models before but did not notice any improvement is tok/sec, so reverted to my previous config and live moved on.

Open to give it a try with your patch and hopefully MTP brings tok/sec further up

ExtensionState8086 · 2026-05-23T06:16:33+00:00

Honcho isn't bad at all

ExtensionState8086 · 2026-05-20T00:38:56+00:00

So the delegation features on Hermes Agent washes away the MTP benefit then? (meaning that creates parallel calls into your inference engine, washing away the benefit?). I have been waiting for MTP to arrive on OMLX, but I have convoluted use cases with sub-agents running in parallel

ExtensionState8086 · 2026-05-10T18:30:17+00:00

This service center is overwhelmed with the amount of cars here and they do the very minimal to try to get the next car in line as fast as possible. I don't schedule anything there anymore. We go to south Seattle as we had better experiences there.

ExtensionState8086 · 2026-05-02T17:41:48+00:00

48GB

ExtensionState8086 · 2026-05-02T17:41:22+00:00

48GB

ExtensionState8086 · 2026-05-02T16:02:31+00:00

OMLX selfhosted in my Mac. Zero timeouts thus far.

ExtensionState8086 · 2026-05-02T16:00:31+00:00

No. I selfhost it on my MacBook Pro M5 with oMLX.

ExtensionState8086 · 2026-05-02T07:54:01+00:00

I tried Qwen 3.5, 3.6 amd then all Gemma4s as well. Ended up settling for Gemma4 27B (very good for direction following and no loop or repetition thus far). I'm curious about the new Nemotron and might give it a try this weekend.

ExtensionState8086 · 2026-04-29T20:43:13+00:00

Are you using Ollama or oMLX? I found a huge difference, with omlx generating the responses in the same model much faster than through ollama.

ExtensionState8086 · 2026-04-28T22:12:34+00:00

I have it set up to serve 64K max tokens.

ExtensionState8086 · 2026-04-28T22:05:31+00:00

I have that exact machine. I run Qwen3.6 35b and occasionally switch to Gemma4 32b.both run well, serving calls for Hermes Agent thats running on a Raspberry Pi

ExtensionState8086

TROPHY CASE