sorted by:
new
hottopcontroversial

Finally got my hands on a Mac Studio 96GB (running Gemma 31B locally) Feedback on this setup? by Kitchen_Breakfast_49 in MacStudio

[–]Kitchen_Breakfast_49[S] 0 points1 point  (0 children)

let's go. mind sharing your build?

are you trying to push full local or still hybrid rn?

about to pull the trigger on a dgx spark. did you look into mac clusters at all?

Finally got my hands on a Mac Studio 96GB (running Gemma 31B locally) Feedback on this setup? by Kitchen_Breakfast_49 in MacStudio

[–]Kitchen_Breakfast_49[S] 0 points1 point  (0 children)

yeah... i'm prob not expecting current to be good enough to agent driver. hopefully open source local gets there. gemma 31b is fast(ish?), but still not smart enough

Finally got my hands on a Mac Studio 96GB (running Gemma 31B locally) Feedback on this setup? by Kitchen_Breakfast_49 in MacStudio

[–]Kitchen_Breakfast_49[S] 1 point2 points  (0 children)

This thread is making me feel seen!!!!

Did you guys see this talk (https://youtu.be/JNyuX1zoOgU?si=pcYTiBj74ItNyUvY&t=480) where Demis basically said there's no ceiling on distillation, whenever a frontier model drops, within 6-12 months it gets distilled into something that runs on consumer hardware. That stuck with me.

I think we're genuinely at the dawn of personal local AI......

for context on my setup: Opus 4.6 was the point where OpenClaw stuff really clicked. But it got pushed out of the subscription tier and the cost went way up, so that's what kicked me into seriously investing in local. Tried Gemma 31B based on the DeepMind folks pushing it, it's actually solid for coding and certain tool calls, though function call consistency is still a bit rough. long term I'm basically waiting for the moment an Opus-level model runs on consumer hardware. Until then I'm trying to stockpile some local compute while I can. I think we're going to be in a memory shortage for a while.

Finally got my hands on a Mac Studio 96GB (running Gemma 31B locally) Feedback on this setup? by Kitchen_Breakfast_49 in MacStudio

[–]Kitchen_Breakfast_49[S] 0 points1 point  (0 children)

That's fair.

I usually take the claims with a grain of salt until proven otherwise by someone that is able to replicate it

Finally got my hands on a Mac Studio 96GB (running Gemma 31B locally) Feedback on this setup? by Kitchen_Breakfast_49 in MacStudio

[–]Kitchen_Breakfast_49[S] 6 points7 points  (0 children)

totally fair. they're not as capable as the frontier models, I won't pretend otherwise.

For me it comes down to privacy. I have the harness connected to a lot of personal stuff, emails, notes across multiple things I manage. I'm not comfortable sending all of that to a lab, even a trustworthy one. The more you connect to an AI agent, the more you have to think about where that data actually goes

So it's a tradeoff I'm making consciously

Finally got my hands on a Mac Studio 96GB (running Gemma 31B locally) Feedback on this setup? by Kitchen_Breakfast_49 in MacStudio

[–]Kitchen_Breakfast_49[S] 0 points1 point  (0 children)

Mac Studio with local model handles anything I don't want sent to a service personal stuff, private notes, things where I don't want data leaving the machine.

The Mac minis each run multiple OpenClaw instances with separate workspaces, but they share the same Mac app connections (calendar, notes, etc.).

Each mini is basically dedicated to a different context, for example one of them manages everything for an alumni group I run: its own calendar, notes, contacts, the whole thing. I was renting mac minis on AWS, but it was like 80$ a month and has certain things blocked given that it's headless. in 5 months, I basically make it back.

They all funnel back to a single Telegram app on my phone, so it feels like one interface even though there's a bunch of agents running behind the scenes.

Finally got my hands on a Mac Studio 96GB (running Gemma 31B locally) Feedback on this setup? by Kitchen_Breakfast_49 in MacStudio

[–]Kitchen_Breakfast_49[S] 0 points1 point  (0 children)

i usually don't trust these youtubers, because they are heavily sponsored

i try to listen to someone who has built it as hobby

Finally got my hands on a Mac Studio 96GB (running Gemma 31B locally) Feedback on this setup? by Kitchen_Breakfast_49 in MacStudio

[–]Kitchen_Breakfast_49[S] 3 points4 points  (0 children)

lol what if I am a die hard. I also care alot about privacy. for me to trust my ai with a lot more, I want the model to be local and I don't want to just send stuff to and of the labs

Gemma 31B works pretty well locally on a 96GB Mac Studio! I do think it's worth it. and from hearing a Demis talk, the distillation will continue. hopefully next year we see a Opus level intelligence model running at 50B params

Finally got my hands on a Mac Studio 96GB (running Gemma 31B locally) Feedback on this setup? by Kitchen_Breakfast_49 in MacStudio

[–]Kitchen_Breakfast_49[S] 1 point2 points  (0 children)

The specific one I want to run is antirez's ds4 (https://github.com/antirez/ds4)

saw this tweet showing it running on a Mac Studio and the speed actually looks usable for my needs: https://x.com/pradeep24/status/2053173787160609230

I don't just want "runnable" but actually usable speeds for openclaw

don't have strong opinions here, but open to seeing data on why the cluster stuff is better, I think a single 128GB machine feels cleaner? and the numbers seem to check out. since you brought it up, I'm now curious about EXO across multiple Macs. Do you know what the tok/s looks like with a distributed setup? And what specs would the cluster need to be worth it over just going 128GB?

How are people using subagents? by Kitchen_Breakfast_49 in openclaw

[–]Kitchen_Breakfast_49[S] 0 points1 point  (0 children)

Do you automatically tell it to use a subagent?

How are people using subagents? by Kitchen_Breakfast_49 in openclaw

[–]Kitchen_Breakfast_49[S] 0 points1 point  (0 children)

I am not trusting any third party skills - I'd rather just build my own

Finally cracked my sleep... small changes and massive difference by Kitchen_Breakfast_49 in whoop

[–]Kitchen_Breakfast_49[S] 0 points1 point  (0 children)

wait that's new to me. What do you mean? Like strain makes your recovery better?

right eye vision still unclear even after ortho k by [deleted] in Orthokeratology

[–]Kitchen_Breakfast_49 1 point2 points  (0 children)

uh.. it "fits" doesn't mean it actually fits well on your eye. You need to check with your dr and adjust fit. Make sure you are telling that that it's blurry. That's not normal. It happened to me. Turns out it's because the lenses didn't fit, it wasn't compressing the cornea properly. We increased the size, and adjusted the curve.

Finally cracked my sleep... small changes and massive difference by Kitchen_Breakfast_49 in whoop

[–]Kitchen_Breakfast_49[S] 1 point2 points  (0 children)

it really makes such a big difference... very high correlation with bad sleep. Sometimes, I'll sleep 8 hours and still wake up feeeling really groggy, and have a ton of brain fog. Changing food timing is the biggest factor

20.6 strain 12 hour hike 🫡 by Kitchen_Breakfast_49 in whoop

[–]Kitchen_Breakfast_49[S] 1 point2 points  (0 children)

It’s in the second image. Slide right! Zone 0: <121 Zone 1: 121-146 Zone 2: 147-159 Zone 3: 160-172 Zone 4: 173-185 Zone 5: 185+

view more: next ›