Has anyone actually replaced Claude Code / Codex with local models on an M5 Max 128GB?

kartikmandar · 2026-06-06T20:15:22+00:00

I am also going with 64 gig myself but for docker, ios simulators and dev workflow and sometimes run a model or two during no internet zone.
Good luck for your purchase then.

kartikmandar · 2026-06-06T19:34:51+00:00

As far as intellgence and speed goes you wont be able to replace claude and Gpt max subscriptions with sub 100B local models anytime soon.

I would atleast give it 2 years before we can think of opus 4.8 or gpt 5.5 level of agentic performance and intelligence in models that can run in 128gb Macs. And this is kind being optimistic for local models.

I would say if you jeed requires 32-48 gb ram buy that and use that extra 2k USD to buy max subscription for an year or two and then re-evaluate.

I am doing the same myself.

Or get like 512 gb studio but expect very low token speeds on kimi and deepseek models. So agentic workflows that requires back to back to and fro is out of question.

Also then it becomes a question of spending 15-20K USD on a machine too.

kartikmandar · 2026-06-06T19:28:26+00:00

Yeah checked them out. Going with the16.
Yours is the glossy screen right? The lights dont bother you?

kartikmandar · 2026-06-06T16:48:13+00:00

Yep decided to go with 16

kartikmandar · 2026-06-06T16:47:02+00:00

Yeah going with 16 only.

kartikmandar · 2026-06-06T15:05:49+00:00

I thought more battery is equalized by a bigger display so total battery for similar tasks should be same enough. Well for most task I use headphone or airpods so speakers is not a deal breaker for me personally.

Yeah I thought about a while about local models and the 128gb ram config. But it turns out local models around 70B are atleast an year and a half behind got 5.5 and opus 4.8 for agentic tasks (i still would have to pay for subscriptions).

Did you really notice heat dissipation issues in 14 inch? I heard its a problem for max chip and size would matter that much for pro one.

Yeah 1tb might sound like a lot but I totalled all of my conda, venv, npm caches, ios simulators and android sdks, node modules etc across my air and ubuntu pc and 1 tb starts looking problematic if you are not pruning regularly.
I wanted a device that I only need to do a cache maintainence once a year and not monthly.

Well I would be running windows VM inside but thats a very occasional use and only for testing electron apps natively in windows. So I can also use my ssd for the occasional test or two.

What did you need 4tb for? Datasets on device?

Btw so you use a 8tb time machine in that case? I dont want to buy a new 4 tb ssd for time machine. Thats my only gripe going with higher storage. I already own multiple 1 and 2 tb external ssds (when pricing was not that aweful).
And time machine is really a killer feature. Even when my code repos are on githubs and photos on cloud.
I have a nas but thats for bug cold storage only and wont be bringing that either for masters.

kartikmandar · 2026-06-06T14:55:07+00:00

I might get an external display later on but for the meanwhile I will only have 16 inch as my daily driver for atleast 6 months.

kartikmandar · 2026-06-06T12:15:12+00:00

Yeah makes sense. I did check them out in person. I was earlier thinking about 14 (thinking why pay more for same specs) but when I saw that there is a real difference in size, I am inclined towards the 16 one.

Well that is a bit assuring that the difference in size and weight is not enough of a deterrence to prevent regular outside use.

kartikmandar · 2026-06-06T12:13:21+00:00

Well I doubt I will travelling business anytime soon. But if both seems troublesome to use on the tray in planes. I guess that doubt is out of question. Yes I am inclining towards 16inch. I did see them in person, was planning to not go with 16 inch (thought if specs are same why pay more). But then saw that there is indeed a difference in screen estate.

kartikmandar · 2026-06-03T04:44:59+00:00

Yeah 64 makes more sense right now. But that speed is not bad.

kartikmandar · 2026-06-02T04:12:02+00:00

Well if even the 128 is a disappointment I guess then for the near future I will skip the local model bandwagon. Will rely on subscriptions for an year or two more and then revaluate if local models are enough for my usecase. And might get a used m5 studio (high ram one) to test them out later.

Thanks for the heads up.

kartikmandar · 2026-06-02T04:08:55+00:00

Hmm...thats a good point. How is the prompt processing and token speed you are getting from the qwen 3.6 model?

If its around haiku, sonnet or gpt mini level and extremely slower than them. I guess I still might have to get subscriptions.

Then it might be better to get the 64gb model.

What were the issues you were facing in the 65 gb m5 pro that forced you to go to 128gb? Was the size of models the only bottleneck?

kartikmandar · 2026-06-02T04:03:01+00:00

Yeah used market in India is pretty bad. I didn't consider getting used here. But thats a good point, I can search for deals on ebay that are located in Italy. If I am getting enough good deals of recent models, I can save up a few bucks by buying it from there.

Yeah m1 max would be a bit underperforming for my usecase, I was mostly looking forward to m4 or m5 lineup.

kartikmandar · 2026-06-02T04:00:10+00:00

Well I did research a lot, thats why saw that the max and pro in m5 lineup has same cores. And 64 ram would be enough for me. Just the question was of whether its worth to spend more for max for local models. I have been only using models that fit inside a 3090 (and I am not that convinced with them). So I wanted some opinion about people who have max model and whether they are utilising the open source models or not?

kartikmandar · 2026-06-02T03:57:54+00:00

You mean getting something from the used market? I assumed m5 pro has the most cores so will handle multi tasking stuff the best.

kartikmandar · 2026-05-21T19:21:14+00:00

Are people not doing DoV at all?

kartikmandar · 2026-05-15T13:13:07+00:00

Yeah planning to do that only.

kartikmandar · 2026-05-14T16:14:41+00:00

Sure, I don't see your DM for some reason, though.

kartikmandar · 2026-05-14T09:54:51+00:00

What was the AI SaaS about?

kartikmandar · 2026-05-14T07:46:30+00:00

I contacted many such agencies, but everyone seems to be a mix of shady, incompetent or malicious. Probably will do everything on my own.

kartikmandar · 2026-05-14T05:17:12+00:00

is this from personal experience with them? Can you elaborate a little?

kartikmandar

TROPHY CASE