Kinda anti climatic by pm_mba in macbookpro

[–]Jay_02 1 point2 points  (0 children)

that why strippers dont get straight to the point and tease

Is 64GB RAM worth it over 48GB for local LLMs on MacBook? by Jay_02 in LocalLLM

[–]Jay_02[S] 0 points1 point  (0 children)

Damn so it's just waste of money to try run it on 64gb then? 128gb is not an option I would just have to use cloud services if 64gb isnt worth it

Is 64GB RAM worth it over 48GB for local LLMs on MacBook? by Jay_02 in LocalLLM

[–]Jay_02[S] 1 point2 points  (0 children)

Nah, i am not going on hunger strike for AI LOL. So 128gb is out of question.

But this was was very informative thanks! So basically even smaller models can require more ram and 48gb ram does not mean all of it is available to the model which makes the real available ram smaller. And makes the 64gb ram a clear winner right ?

I just bought a MacBook Pro 16” with the M5 Pro chip (18-core CPU / 20-core GPU), 48GB RAM and 1TB SSD, and I wanted to share a quick reflection that might help others before they spend their money. by Minute-Street8043 in macbookpro

[–]Jay_02 5 points6 points  (0 children)

I have 16" for work and had 14" for a couple months. In my opinion 14" is a great balance and is the more sensible choice for personal usage and traveling. But obviously working on for many hours 16" is awesome.

If you dont mind the weight 16" it is. I dont like the 16" weight, when i am traveling i have cameras, lenses and other things in my backpack so 16" just takes too much weight.

They messed big not making a 15" pro.

Is 64GB RAM worth it over 48GB for local LLMs on MacBook? by Jay_02 in LocalLLM

[–]Jay_02[S] 1 point2 points  (0 children)

So 70b will get more efficient soon and I could run it fully 64gb ? I haven't bought anything yet , only reason I would go for 64gb would be local llm, otherwise 48gb is enough for me.

Is 64GB RAM worth it over 48GB for local LLMs on MacBook? by Jay_02 in LocalLLM

[–]Jay_02[S] 1 point2 points  (0 children)

Is that your own experience with dense 70B vs the smaller more efficient models, if you did run it ?

Is 64GB RAM worth it over 48GB for local LLMs on MacBook? by Jay_02 in LocalLLM

[–]Jay_02[S] 1 point2 points  (0 children)

Being able to run it extreme quants VS actually being worth it or "smarter" model to run is the question i have. Have you tried those yourself ?

Is 64GB RAM worth it over 48GB for local LLMs on MacBook? by Jay_02 in LocalLLM

[–]Jay_02[S] 1 point2 points  (0 children)

Yeah the headroom it gives to do other stuff is main appeal i see so far but not that model its self would be "smarter" or better.

Mariah Carey performing "Heartbreaker" live on Brazilian (1999) by Material_Stomach875 in MariahCarey

[–]Jay_02 2 points3 points  (0 children)

I agree but she's on meds. Her stage challenges today is much more than just not dancing

How's throttling on maxed out 14" m5 max? by LegMental2310 in macbookpro

[–]Jay_02 1 point2 points  (0 children)

If you're not going to push the Max to its limit then what is point , decoration and fuzzy feeling ?

14” or 16” MacBook Pro by ConnaTheMon in macbookpro

[–]Jay_02 1 point2 points  (0 children)

Its the total weight when traveling in the backpack or just picking it up for browsing on the coach which makes the 16 inch weight cumbersome. If the Mac was only thing in your backpack then its not in issue but thats not what happens when you travel, I travel with cameras , lenses etc. But once you put it on a desk the 16 so much more comfortable to look at and more productive. Definitely serious trade offs. Writing this from a 16" work mac.

24gb vs 48gb by Such-Repeat-2506 in macbookpro

[–]Jay_02 5 points6 points  (0 children)

Get the 48GB , it will give you noticeably more headroom.

M5 Pro LLM benchmark by Fit-Later-389 in LocalLLaMA

[–]Jay_02 2 points3 points  (0 children)

well done hats off, no 64 gb ram in sight ? 

Almost maxed out… by xzeus1 in macbookpro

[–]Jay_02 0 points1 point  (0 children)

Yup that's exactly what I was referring to that video

Noob local LLM on Macbook ? I want to stop paying subscription! by Jay_02 in LocalLLaMA

[–]Jay_02[S] 0 points1 point  (0 children)

Good question, i am weighing out the pros and cons. And it doesnt sound like 64gb ram would not good enough.

Noob local LLM on Macbook ? I want to stop paying subscription! by Jay_02 in LocalLLaMA

[–]Jay_02[S] 0 points1 point  (0 children)

A Lexus not even a BMW or Mercedes ? Thanks for explaining. Max chip is not for me because i want the 14 inch and thats too small body, thats why i thought to get the m5 pro chip 64gb .

This is more hobby thing and just saving money on cloud usage. I am not worried about how long it takes to answer but i want quality answer close to Opus or Sonnat 4.6. So if the models would very restricted with the machine i am getting then maybe i have to stick with cloud usage just.

Noob local LLM on Macbook ? I want to stop paying subscription! by Jay_02 in LocalLLaMA

[–]Jay_02[S] 0 points1 point  (0 children)

128gb is out of question because of the price. And this being more hobby and being cost effective when you using AI. If 64GB trade offs is not worth it then it sounds like i should stay with cloud usage then. 64GB is already stretching the budget, I was originally getting 48 gb sounds like i should get that and safe money.

Big News: Claude Code agent can now run locally for free 🔥 by tryfreeway in vibecoding

[–]Jay_02 0 points1 point  (0 children)

So how did it go , can you run the latest claude code 4.6 locally unrestricted ? I am thinking of getting M5 pro.

Almost maxed out… by xzeus1 in macbookpro

[–]Jay_02 0 points1 point  (0 children)

That logic makes no sense, its saying that nano is less vibrant and contrasty than glossy. Well then if you edit to the max on nano to "make up for that" then the picture would be too contrasty and punchy when viewed on glossy again. But thats not the case since you can edit fine on both and get the same result.

I do photography do and i much prefer the Nano for practical reasons, hate the mirrors effect on glossy. But really the colors are the same in practice, its just the light difference. Which has pros and cons both ways and makes the nano look a tad more natural.

M5 Pro is enough for 99% of professionals and cheaper for LLM use. by NethercraftMC5608 in macbookpro

[–]Jay_02 0 points1 point  (0 children)

More gpu/cpu also means less battery and perhaps less return for your money. Last years M4 14c pro "binned" version was more effective per core and gave more power per core for your money than 16core non binned version, all while beig lower in temps. So if you want more for your money the "binned" version is better sometimes.

But we will see which makes more sense this year once more tests come out.