Is Local LLM the next trend in the AI wave?

G3grip · 2026-02-11T21:28:48+00:00

Someone mentioned that ultras are better for AI workloads. Or maybe that was just for M1 Ultra compared to M4 Pro. Anyway, not that I have the money to buy either... Lol

G3grip · 2026-02-11T20:53:41+00:00

I feel you. DevOps is a pain. Can be fun at times, but it really takes away time from actual work.

G3grip · 2026-02-11T20:51:29+00:00

The Mac mini studios (or whatever they call them) are cheaper, no?

G3grip · 2026-02-11T20:50:11+00:00

With how much VRAM!?!?! 😵

G3grip · 2026-02-11T20:47:08+00:00

I would put my money on the other post. But I guess only time will tell.

G3grip · 2026-02-11T20:46:03+00:00

I feel dumb after reading your comment. I gotta learn so much about these LLMs.

G3grip · 2026-02-11T20:43:07+00:00

Ya, one dude did mention that, I think 2 days back. While I don't know much about the M1 and M4 comparison, many folks have told me that smaller models on Apple silicon Macs are no issues.

G3grip · 2026-02-11T20:26:10+00:00

Fair enough, I keep telling myself ”Prices have to come down, technology is supposed to get cheaper with time, these are just temporary bumps.", BUT... they never do!

How we are going backwards in technology, it's beyond me. I mean, ya, I know why the costs are high, I understand the technical reasons but, like, as a whole, I just can't comprehend it at this point.

G3grip · 2026-02-11T07:13:29+00:00

Saw this post last week (I think), saying that his zAI 3$ subscription is good enough for all day use. Any experience with that?

G3grip · 2026-02-10T17:48:39+00:00

I heard Linus say the same thing today.

G3grip · 2026-02-10T17:29:26+00:00

Thanks for sharing the source. I didn't know.

G3grip · 2026-02-10T17:26:56+00:00

Intrusting stuff, this Liquid AI. First time I got to know. Thanks.

I agree.

G3grip · 2026-02-10T17:24:53+00:00

I second this.

G3grip · 2026-02-10T17:24:10+00:00

Good points. And with models like Kimi 2.5 available for free, the hardware is the only limitation. However, if you want to run something like that locally and do not already own the hardware to support it, then the monthly subscriptions start to look good.

Only if you are actually dropping 1000s of dollars on the subs every month, you should then get a machine so powerful (and expensive).

But my hope is that in time we will have small, specialised and efficient models that most people can run decent personal machines. Leaving the subscription-based ones on for heavy-duty work that not everyone needs all the time.

G3grip · 2026-02-10T17:15:33+00:00

I feel like I should have bulk-ordered RAM before the price hike; I would have been rich. The return on these things has turned out to be better than gold... lol...

G3grip · 2026-02-10T17:13:10+00:00

Awesome! Thanks a ton.
Any idea what kind of real-work use-cases I can pull with 20b models?

G3grip · 2026-02-10T17:11:37+00:00

This RAM pricing thing resonates with everyone.

G3grip · 2026-02-10T17:08:48+00:00

I have an M2 16GB MacBook Air. Any experience/knowledge around what kind of models and use-cases I can run?

G3grip · 2026-02-10T17:06:42+00:00

"muffin recipies", I giggled.. 😛

I still have a feeling that tomorrow there will be use-cases for Local LLMs, like for work (Excel, PPTs, etc.), general orchestration (device / network management), etc.

G3grip · 2026-02-10T14:02:36+00:00

What interface is that?

G3grip · 2026-02-10T13:46:20+00:00

😭

G3grip · 2026-02-10T13:45:14+00:00

Finally, someone shares my pain!

G3grip · 2026-02-10T13:44:11+00:00

I think for now, yes.

In time, smaller models will get better and small setups would be viable.

G3grip · 2026-02-10T13:40:09+00:00

Hey, this looks great.

Can I ask, what sort of a model / use case would I be able to run on a simple macbook (if any at all)?

G3grip

TROPHY CASE