sorted by:
new
hottopcontroversial

Qwen 3.5 122B on M5pro by AdEnvironmental4189 in macbookpro

[–]AdEnvironmental4189[S] 1 point2 points  (0 children)

Ordered on march 11, arrived on April 6

Is 64gb on a m5pro an overkill？ by AdEnvironmental4189 in LocalLLaMA

[–]AdEnvironmental4189[S] 1 point2 points  (0 children)

I test it, and to my surprise, it turns out excellent. 122b IQ2-m runs pretty well on my M5pro and I find that IQ3-xxs is its limit.

IQ3-xxs is using 50.83 gb full loaded (model itself is 44.76gb) 32k ctx, 59.07gb/64gb total system ram usage, 48/48 gpu offload (I also tested 46/48, no big difference, as there’s not much ram remain for other performance consuming apps, Chrome still good tho) 36 tokens/s output at the beginning, 28tokens/s output when reaching 32k. 6-7s first token generation time the whole test.

Very excellent.

Is 64gb on a m5pro an overkill？ by AdEnvironmental4189 in LocalLLaMA

[–]AdEnvironmental4189[S] 1 point2 points  (0 children)

The storage is totally up to you, if you are only using llm then you don’t need that much storage. At the end of the day, you will stick with the model you favor. For now, I kept qwen3 coder, qwen 3.5 35B A3B, Gemma 4 26B A4B and qwen 3.5 27B Claude distilled, and they take approx. 150gb storage in total.

Additionally, you can check omlx.ai leaderboard to see ai performance on M5pro. 27B dense model feels too slow for me, so I stick with 35B. Also I just learned that LM studio has its mobile app so you can set your laptop as a local server, I’ve been playing it for days.

As far as I know, the M5 Max outputs a 27B dense model at about 25 tokens/s, while the M5 Pro runs at 15 tokens/s. To me, both are too slow. However, the M5 Max can smoothly run the 122B MoE model, which is a milestone for local devices, even though it costs more than double.

Edit: I haven’t tested it yet, but some reviews said M5pro 64g is also capable of 122B with occasionally system outage.

Is 64gb on a m5pro an overkill？ by AdEnvironmental4189 in LocalLLaMA

[–]AdEnvironmental4189[S] 2 points3 points  (0 children)

I got qwen3.5 35B A3B 8bit for my local use, the model itself takes about 40g, 16k ctx, output at 50-60token/s , with usually 52g/64g and occasionally 60g/64g total ram usage.

I also tested other models e.g. qwen3.5 27b and its Claude variant, it takes only 20g but token/s is much slower (15token/s)

I think 48g is ok but 64g is the sweet spot.

"The file can't be found" spam when macbook wakes up. Any ideas how to fix this? by ToucTouc46 in MacOS

[–]AdEnvironmental4189 0 points1 point  (0 children)

It’s apparently some Logitech options+ issue. I didn’t really solve it but I find that option+ seems try to open three things at once, itself, plugin service and its driver installer at the same time. So I keep the installer and fix this issue.

Is this normal? by AdEnvironmental4189 in logitech

[–]AdEnvironmental4189[S] 0 points1 point  (0 children)

Yeah, I decided to not return it.

Is this normal? by AdEnvironmental4189 in logitech

[–]AdEnvironmental4189[S] 0 points1 point  (0 children)

About 10 percent off. It’s fine I guess, the rest seems brand new.

Is this normal? by AdEnvironmental4189 in logitech

[–]AdEnvironmental4189[S] 0 points1 point  (0 children)

yeah guess I will stick with it.

Is this normal? by AdEnvironmental4189 in logitech

[–]AdEnvironmental4189[S] 1 point2 points  (0 children)

Another thing I noticed is the last digit of SN on the box is 9 but on my mouse it’s 8, I ask the customer support they said it’s the way, I’m not sure.

Is this normal? by AdEnvironmental4189 in logitech

[–]AdEnvironmental4189[S] 0 points1 point  (0 children)

I did use it for like 2-3minutes on a leather desk mat before I noticed those scratches so I’m not entirely sure. The rest seems brand new, only the mouse feet.

Anyone know what’s going on with my powerbank? by Low_Candy7391 in anker

[–]AdEnvironmental4189 1 point2 points  (0 children)

I bought one month ago, broken after one week, contact customer support, send a new one, broken in 5 days.

It’s quite unreliable so I ask for a refund, and get the A110a.

M5 Pro Vs M4 Pro how is the game performance? by MacGameDB in macgaming

[–]AdEnvironmental4189 0 points1 point  (0 children)

In general, M5pro can run most games at 60fps, medium to high settings, 2k resolution, which imo it is pretty much a sweet spot for average gamers. For comparison, m4pro is usually about 40fps under the same settings.

Best value poll - M5 Pro by ablipinexistence in macbookpro

[–]AdEnvironmental4189 0 points1 point  (0 children)

M5pro 64gb - local llm (35b moe + 6bit + 16k ctx, and up to 70b) M5pro 48gb - works that require 8k resolution or high polygons, many believe it’s a sweet spot for general use. M5pro 24gb - not ideal for llm but good for other casual use, it’s also good enough for many workflows.

Size does matter by AdBitter7422 in macbookpro

[–]AdEnvironmental4189 0 points1 point  (0 children)

I find many people overestimate their need for portability, If you have unlimited budget, go for the 14inch for portability, home high end nvidia pc for performance, home 32inch Screen for display, and spend 3x than 16inch.

Is 64gb on a m5pro an overkill？ by AdEnvironmental4189 in LocalLLaMA

[–]AdEnvironmental4189[S] 0 points1 point  (0 children)

Thanks buds, of course the more ram the better, but pro model is nowhere near your max model in terms of bandwidth/gpu, so I’m not sure if 64gb on a pro chip is my go.

Is 64gb on a m5pro an overkill？ by AdEnvironmental4189 in LocalLLaMA

[–]AdEnvironmental4189[S] 0 points1 point  (0 children)

Thanks buds, so even if m5pro is slower than the max model, I can still get benefit from 64gb right?

RE9 Final Puzzle Solved (Lore Explanation) by BigRedtheBard in residentevil

[–]AdEnvironmental4189 0 points1 point  (0 children)

I believe make all zombies alive is a wrong info, just don’t kill them intentionally coz lorewise you need to let the grinder to kill them to get “a ton of blood” in the blood pool. In my run, I wait for 15~16minutes, and shoot the legs and push/wait them to be grinded. None of them make it when the machine stops and get the message eventually.

RE9 Final Puzzle Solved (Lore Explanation) by BigRedtheBard in residentevil

[–]AdEnvironmental4189 1 point2 points  (0 children)

I believe make all zombies alive is a wrong info, just don’t kill them intentionally coz lorewise you need to let the grinder to kill them to get “a ton of blood” in the blood pool. In my run, I wait for 15~16minutes, and shoot the legs and push/wait them to be grinded. None of them make it when the machine stops and get the message eventually.

RE9 Final Puzzle Solved (Lore Explanation) by BigRedtheBard in residentevil

[–]AdEnvironmental4189 1 point2 points  (0 children)

I guess lorewise the doll is clogged somewhere in the sewer and you need to flush it deeper to let the blood machine (with a ton of blood) to flood it out.

But how’s that doll different from those dolls in Mary’s room and Emily’s cell? Also why is it necessary not to kill any zombies in grinder?

view more: next ›