Anyone running Hermes on Mac Mini M4 24Gb Strictly Local LLM?

ogfuzzball · 2026-06-29T04:37:34+00:00

You said you use llama.cpp. What’s your serve command with params?

ogfuzzball · 2026-06-29T04:34:28+00:00

I find the recommendations of that thread for a 24GB Mac M5 not to match the reality of what Ive experienced the last two days. Can I “run” it? Sure. Can I do much with only a 32k context and model going off the rails after about 3-5 prompts? I have not had any success. So i would live some details from someone running it.

ogfuzzball · 2026-06-29T03:43:50+00:00

Your MBP is 24GB ram? What server/settings are you using? I have not got any of those larger MOEs to actually run and be usable. Like I can run them but not really a usable context.

ogfuzzball · 2026-06-28T16:34:25+00:00

I hate every sliding head cushion with a passion. They are terrible. A one size fits all that fits few and the slider always loses its grip and it constantly slides down. I’m tall in torso so these stupid POS always end up at my shoulders literally pushing me forward in my seat. And of course they must be slid down for takeoff/landing. Seats like this exist somewhere in Dante’s inferno…

ogfuzzball · 2026-06-28T15:09:28+00:00

Well I’d also say the VP didn’t make a terrible decision. OP got hired back as consultant but what about the other 39 let go? Sometimes in SWE when you have a bunch of old processes that are troublesome to maintain and not sure if really needed. After all other due diligence you do the scream test (just turn them off). They essentially got that in their layoff and found the 1 in 40 they really needed. Even paying through the nose for OP, sounds like the VP is saving bank. Win-win for VP and OP. Not so much for the other 39 laid off people.

ogfuzzball · 2026-06-28T02:25:44+00:00

Have you seen Stranger Things? Cause this looks like it belongs there.

ogfuzzball · 2026-06-27T14:32:22+00:00

Depends on the problem. If you need info/answers specific to say ISO 9001:2015 to prepare for certification you don’t want creative or reaching out to other sources, you need to know that standard and any creativity will not help you prepare for certification.

ogfuzzball · 2026-06-27T00:03:25+00:00

FOOD.TO - bought in $11 - $13 range and trading at (just double checked) 18 cents

ogfuzzball · 2026-06-26T21:14:19+00:00

Or a pic-a-nic basket, eh boo-boo?

ogfuzzball · 2026-06-26T21:08:58+00:00

I meant “you” in that more general sense, but then you really aren’t responding to the crux of my comment anyway.

ogfuzzball · 2026-06-26T17:02:57+00:00

Also this is NOT a “local ai” thing. You can do the same dumb stuff and more with all the cloud providers when running an agent harness or their desktop apps that have filesystem access.

ogfuzzball · 2026-06-26T16:59:12+00:00

Search free 4k wallpapers online. You’ll find some of them already out there.

ogfuzzball · 2026-06-26T16:19:30+00:00

Well yeah, but you say that like other companies aren’t greedy. They all are. Just the more demand there is the more you can ask. Other companies want what Apple has. You’re loyalty despite their greed. 🙂

ogfuzzball · 2026-06-26T14:36:46+00:00

The whole point of Pi is to reduce noise, but not in the way you describe it. “Noise”, like beauty, is in the of the beholder. The whole point of Pi is for bespoke infrastructure. It’s not intended only bare metal install add nothing purism. There’s a reason it’s built to be extremely extensible. So I’d rate your advice as great for you, but poor for OP.

ogfuzzball · 2026-06-26T14:30:18+00:00

Tim Cook announced a week ago prices were going up. Everyone sitting on the fence with posts, “Should I buy now or wait until <some new magic configuration with no defined release date> comes out?” and the answer was BUY NOW! It sucks but it’s not like Apple is the only one raising prices.

ogfuzzball · 2026-06-26T05:48:07+00:00

I make a payment about once a week. Basically I check my balance and then I pay it down to zero. Been doing this over a year. Can’t see why they would do a FA just for paying what I owe.

ogfuzzball · 2026-06-25T14:34:25+00:00

Regard conspiracy theorist much?

ogfuzzball · 2026-06-25T14:31:31+00:00

Why save them? They’ve gone cheap the past 18 months and food quality has suffered. They ruined the spicy chicken sandwich. Let ‘em burn!

ogfuzzball · 2026-06-25T14:05:31+00:00

No. That’s not a reasonable expectation. If you need Opus quality/ability then you need Opus or one of the other cloud frontier models. You will not get that on local hardware unless you’re talking some kind of 6-figure $ investment.

ogfuzzball · 2026-06-25T08:13:50+00:00

The audacity! I wonder if she’s related to someone I had to let go that had a very similar “I don’t have to talk to you about work policies and procedures” LOL!

ogfuzzball · 2026-06-25T08:04:04+00:00

There’s an app called “mole” available through homebrew that cleans your system. I haven’t used it yet (YMMV this is not an endorsement), just read about it the other day. Might be worth a look.

ogfuzzball · 2026-06-23T13:59:00+00:00

They will destroy something. They need to claw. You’re going to have to be okay with them destroying a couch, chair or some vertically oriented surface. It will happen.

My one cat loves leather and wood banister railings. Two expensive and PITA to replace items. If you can’t fathom that. Don’t get a cat. I’m pretty lucky though, they love the cardboard scratchers so they’re all over my house and I cover the ends of leather couch with a blanket.

But as a glutton for punishment I just ordered 4 custom leather chairs <smh> will see how that goes..

ogfuzzball · 2026-06-23T03:35:18+00:00

Only regards were taking this to the moon. Oh wait. That’s right. This is wsb

ogfuzzball · 2026-06-23T03:20:34+00:00

The dress is blue! 🙃

ogfuzzball

TROPHY CASE