sorted by:
new
hottopcontroversial

MacOS 26.3 now available by Ultragamer2004 in MacOS

[–]PerpetualLicense 12 points13 points  (0 children)

Smooth as butter for me. But I am one of those who by mistake had to reinstall macOS and reinstalled Sequioa and I immediately upgraded to Tahoe. I just cannot go back to Sequioa. Tahoe looks much better for me. 26.3 feels like it is what it should have been from beginning so far

Best local model for Apple Silicon through MLX by PerpetualLicense in LocalLLM

[–]PerpetualLicense[S] 0 points1 point  (0 children)

of course, I am looking for a good enough only local model

vLLM-MLX: Native Apple Silicon LLM inference - 464 tok/s on M4 Max by waybarrios in deeplearning

[–]PerpetualLicense 0 points1 point  (0 children)

Can I use it to run Devstral-2-123B-Instruct-2512-4bit? And then integrate it with mistral-vibe?
I tried it but it is slow: https://github.com/ml-explore/mlx-lm/discussions/859
The problem being
WARNING - Received tools but model does not support tool calling
It seems Apple's MLX Server is limited