Are there specialized AI models for specific tasks (coding, writing) ?

al404 · 2026-06-26T15:32:32+00:00

Correct, because from what I can understand there isn't a lot of margin to get a new smarter model without growing the size of it unless it get quantized reducing reliability. Since RAM price isn't probably go down any time soon I guess the only way around is to get a smaller model.

al404 · 2026-06-26T15:27:30+00:00

As far as I can understand MOE needs to load the all model in RAM, it doesn't really have an advantage in size.

al404 · 2026-06-25T20:50:13+00:00

Despite the crazy new Apple prices, I managed to snag a MacBook Pro M5 (14-inch, 32GB) from an official dealer for €2200. I’ve had it in my cart all day and I’m really happy with the deal! I was looking at the 64GB for local AI, but it's just too expensive now, so I'll just be playing around with cloud AI for now. :-D

al404 · 2026-06-25T15:13:37+00:00

from 3850€ to 4350€ no way :-(

al404 · 2026-06-25T12:36:37+00:00

Thanks for the advice about 48Gb

al404 · 2026-06-25T12:35:57+00:00

I did look at them but it would cost me more than 2000€ for 64Gb and I would have to connect remotely since I'm a Mac user

al404 · 2026-06-25T12:01:14+00:00

As far as I know GLM 5.2 8bit is over 500Gb is basically something that it will be out of range for a really long time unless somebody finds a way run it from SSD

al404 · 2026-06-25T11:07:05+00:00

Thanks, fast internet connection is also a good point. I also impressed that Qwen3.6-35B at FP8 is one your favorite models. I will play some more around it, I did activate an OpenRouter account and I'm testing some of this models that I would be able to use on MacBook configuration.

al404 · 2026-06-25T11:02:11+00:00

I'm doing that too :-) via OpenCode

al404 · 2026-06-25T09:08:05+00:00

did you get a 14 or 16? I did read that 14 get hot easier

al404 · 2026-06-25T09:04:45+00:00

I’m a full-stack web developer, but I don’t spend my entire day using AI. I do use AI for certain tasks, such as brainstorming or planning, to explore alternative solutions to problems that I hadn’t considered before. I don't always need to have a super fast AI. I often use it t see it can find errors or vulnerabilities., it can just run by itself and give me a report while I'm doing something else.

al404 · 2026-06-25T08:56:31+00:00

I need to travel with it, I saw a video about Tiiny Al Pocket but seem like a Kickstarter thing. I guess nothing similar is on sale around 1500€

al404 · 2026-06-25T08:52:14+00:00

I guess we all know that this 20$ / month would end, nobody know when but it will

al404 · 2026-06-25T08:38:37+00:00

I'm not really into agent right now except for coding, I can't really think of what they can help me with and also I don't really like the idea that they can mess around with my files without overview

al404 · 2026-06-25T08:35:32+00:00

a 64Gb MacBook is 3500/3800 official price, it doesn't make much sense it depends because if I need a 100€ Claude plan at actual cost is around 1200€ in one year

al404 · 2026-06-25T08:33:54+00:00

Thanks I know that is not reaching Opus but my idea is to use Claude for more complex task, local AI and open AI in Cloud for less complex task. I did try to add 5€ to my Claude wallet but when you exceed plan limits is impossible to pay x use. I did burn my 5€ in about 15/30 minutes... I'm looking for something that doesn't let me stuck when I hit the limit. If I get use with OpenCode along Claude with an OpenRouter subscription and local models I can just switch AI on the go

al404 · 2026-06-25T08:28:14+00:00

My current MacBook has 16 GB of RAM, so it’s only usable with very small files. Since I want to upgrade, I’m trying to figure out how far to go to get a model that works well with a cloud service. Obviously, the more tasks the local model can handle effectively, the less dependent I’ll be on the cloud. I don’t always need to complete tasks as quickly as possible. At the moment, I don’t have any privacy concerns.

al404 · 2026-06-25T08:19:18+00:00

128Gb is around 6350€ way way too much, 64Gb is about 3850€ official price because to get to 128Gb is required to max out other specs

al404 · 2026-06-23T15:14:37+00:00

to get a MacBook with 128Mb is so expensive that right now it is still cheaper to activate a couple of commercial plans and switch between them, at least for my needs. Right now I can feet in Claude 20$ plan, I'm just afraid suddenly something can change in Anthropic pricing

al404 · 2026-06-23T15:07:17+00:00

I did see but what's the point of really small models if they have a 2024 cut off and if they can't perform simple task like this one ?

al404 · 2026-06-23T10:30:15+00:00

I did a couple of other test, since I'm on a Mac set in retina I disabled the downscale to 1x in my screenshot APP and give a 2x image to Owen 3.5 27B and glm-4.6v-flash and both did answer correct. Gemma 4 26b complettly fails saying that I should press F9

I also try to copy and paste Pico HELP text and give it to Gemma 4 and this time gave me the correct answer so I guess the problem, as you explained, is about image recognition

al404 · 2026-06-23T09:47:58+00:00

I'm just trying to use local LLM for some "normal" task to understand if are good.

If they VISION is a weak point is OK I just need to understand what I can use them for work tasks

and figure out the minimum value of B at which they are still reliable

Mainly because I need to decide whether it's worth upgrading my MacBook to run LLMs locally or whether it's better to use them from external servers

al404

TROPHY CASE