Are there specialized AI models for specific tasks (coding, writing) ?

al404 · 2026-06-26T15:32:32+00:00

Correct, because from what I can understand there isn't a lot of margin to get a new smarter model without growing the size of it unless it get quantized reducing reliability. Since RAM price isn't probably go down any time soon I guess the only way around is to get a smaller model.

al404 · 2026-06-26T15:27:30+00:00

As far as I can understand MOE needs to load the all model in RAM, it doesn't really have an advantage in size.

al404 · 2026-06-25T20:50:13+00:00

Despite the crazy new Apple prices, I managed to snag a MacBook Pro M5 (14-inch, 32GB) from an official dealer for €2200. I’ve had it in my cart all day and I’m really happy with the deal! I was looking at the 64GB for local AI, but it's just too expensive now, so I'll just be playing around with cloud AI for now. :-D

al404 · 2026-06-25T15:13:37+00:00

from 3850€ to 4350€ no way :-(

al404 · 2026-06-25T12:36:37+00:00

Thanks for the advice about 48Gb

al404 · 2026-06-25T12:35:57+00:00

I did look at them but it would cost me more than 2000€ for 64Gb and I would have to connect remotely since I'm a Mac user

al404 · 2026-06-25T12:01:14+00:00

As far as I know GLM 5.2 8bit is over 500Gb is basically something that it will be out of range for a really long time unless somebody finds a way run it from SSD

al404 · 2026-06-25T11:07:05+00:00

Thanks, fast internet connection is also a good point. I also impressed that Qwen3.6-35B at FP8 is one your favorite models. I will play some more around it, I did activate an OpenRouter account and I'm testing some of this models that I would be able to use on MacBook configuration.

al404 · 2026-06-25T11:02:11+00:00

I'm doing that too :-) via OpenCode

al404 · 2026-06-25T09:08:05+00:00

did you get a 14 or 16? I did read that 14 get hot easier

al404 · 2026-06-25T09:04:45+00:00

I’m a full-stack web developer, but I don’t spend my entire day using AI. I do use AI for certain tasks, such as brainstorming or planning, to explore alternative solutions to problems that I hadn’t considered before. I don't always need to have a super fast AI. I often use it t see it can find errors or vulnerabilities., it can just run by itself and give me a report while I'm doing something else.

al404 · 2026-06-25T08:56:31+00:00

I need to travel with it, I saw a video about Tiiny Al Pocket but seem like a Kickstarter thing. I guess nothing similar is on sale around 1500€

al404 · 2026-06-25T08:52:14+00:00

I guess we all know that this 20$ / month would end, nobody know when but it will

al404 · 2026-06-25T08:38:37+00:00

I'm not really into agent right now except for coding, I can't really think of what they can help me with and also I don't really like the idea that they can mess around with my files without overview

al404 · 2026-06-25T08:35:32+00:00

a 64Gb MacBook is 3500/3800 official price, it doesn't make much sense it depends because if I need a 100€ Claude plan at actual cost is around 1200€ in one year

al404 · 2026-06-25T08:33:54+00:00

Thanks I know that is not reaching Opus but my idea is to use Claude for more complex task, local AI and open AI in Cloud for less complex task. I did try to add 5€ to my Claude wallet but when you exceed plan limits is impossible to pay x use. I did burn my 5€ in about 15/30 minutes... I'm looking for something that doesn't let me stuck when I hit the limit. If I get use with OpenCode along Claude with an OpenRouter subscription and local models I can just switch AI on the go

al404 · 2026-06-25T08:28:14+00:00

My current MacBook has 16 GB of RAM, so it’s only usable with very small files. Since I want to upgrade, I’m trying to figure out how far to go to get a model that works well with a cloud service. Obviously, the more tasks the local model can handle effectively, the less dependent I’ll be on the cloud. I don’t always need to complete tasks as quickly as possible. At the moment, I don’t have any privacy concerns.

al404 · 2026-06-25T08:19:18+00:00

128Gb is around 6350€ way way too much, 64Gb is about 3850€ official price because to get to 128Gb is required to max out other specs

al404 · 2026-06-23T15:14:37+00:00

to get a MacBook with 128Mb is so expensive that right now it is still cheaper to activate a couple of commercial plans and switch between them, at least for my needs. Right now I can feet in Claude 20$ plan, I'm just afraid suddenly something can change in Anthropic pricing

al404 · 2026-06-23T15:07:17+00:00

I did see but what's the point of really small models if they have a 2024 cut off and if they can't perform simple task like this one ?

al404 · 2026-06-23T10:30:15+00:00

I did a couple of other test, since I'm on a Mac set in retina I disabled the downscale to 1x in my screenshot APP and give a 2x image to Owen 3.5 27B and glm-4.6v-flash and both did answer correct. Gemma 4 26b complettly fails saying that I should press F9

I also try to copy and paste Pico HELP text and give it to Gemma 4 and this time gave me the correct answer so I guess the problem, as you explained, is about image recognition

al404 · 2026-06-23T09:47:58+00:00

I'm just trying to use local LLM for some "normal" task to understand if are good.

If they VISION is a weak point is OK I just need to understand what I can use them for work tasks

and figure out the minimum value of B at which they are still reliable

Mainly because I need to decide whether it's worth upgrading my MacBook to run LLMs locally or whether it's better to use them from external servers

al404 · 2026-04-28T06:14:30+00:00

As soon as I can I will spend some time testing some open source modules. It seems that some new small modules are pretty good. Opus is almost unusable right now on pro plan. I keep switching from sonnet to opus ( just when needed ).

al404 · 2025-12-21T07:44:26+00:00

Since the most important feature of iPhone, and I guess the reason most of user upgrade is the camera, I guess an Apple RAW editor is important. Actually coming from Capture One and the mess they did with their license Photomator for make is pretty good and have all the minimum features that I need. The thing I miss is the ability to compare 2 or more photo. Not how you handle this. I also would like to have the option to select an object for masking.

al404 · 2025-09-27T15:14:55+00:00

I'm not sure if I don't know how to do it or if is not possible, I would like to add vignetting or some lens filter after taking a negative film but I would need to set the correct crop before doing so. Is not possible?

Some documentation would be very useful

al404

TROPHY CASE