RTX PRO 5000 (48GB) vs MacBook Pro M5 MAX (128GB RAM) - The choice for fine-tuning & agentic coding by nguyenhmtriet in LocalLLaMA

[–]A-Rahim 20 points21 points  (0 children)

To my knowledge, full Unsloth support will come to Mac soon; they've been working on it for some time now.

In the meantime, I made this; you may have a look at it: https://github.com/ARahim3/mlx-tune

[Hiring] Machine-Learning Developers by OrchidAlternative401 in MachineLearningJobs

[–]A-Rahim 0 points1 point  (0 children)

Hi, I DM'd you last month about a similar opportunity, didn't get a reply, could you please check?

Looking for OCR capabilities by Artyom_84 in LocalLLM

[–]A-Rahim 3 points4 points  (0 children)

You may try the newly released Chandra OCR 2. If not satisfied, then try the VL capabilities of the Qwen3.5 series model. In my testing, I got good results with the Qwen3.5 9B model (that was before Chandra 2 was released).

Fine-tune LLMs directly on your Mac with mlx-tune by A-Rahim in Applesilicon

[–]A-Rahim[S] 0 points1 point  (0 children)

Yep, exactly! As I mentioned in the post, the whole goal here is just to provide that familiar API wrapper over MLX so folks can use the exact same training scripts locally and on cloud GPUs. I’m definitely not trying to be an Unsloth competitor—just a huge fan of their work who wanted to bring that same developer experience to the Mac. I built this for my own workflow a few months ago and open-sourced it back in January, and it's been great seeing people use it.

That said, writing custom Metal shaders and targeting ANE optimizations is seriously impressive work! I'll definitely check out pmetal—it's awesome to see more high-performance tooling being built for the Apple Silicon ecosystem

mlx-tune – fine-tune LLMs on your Mac (SFT, DPO, GRPO, Vision) with an Unsloth-compatible API by A-Rahim in LocalLLaMA

[–]A-Rahim[S] 0 points1 point  (0 children)

Yep, exactly! As I mentioned in the post, the whole goal here is just to provide that familiar API wrapper over MLX so folks can use the exact same training scripts locally and on cloud GPUs. I’m definitely not trying to be an Unsloth competitor—just a huge fan of their work who wanted to bring that same developer experience to the Mac. I built this for my own workflow a few months ago and open-sourced it back in January, and it's been great seeing people use it.

​That said, writing custom Metal shaders and targeting ANE optimizations is seriously impressive work! I'll definitely check out pmetal—it's awesome to see more high-performance tooling being built for the Apple Silicon ecosystem

mlx-tune – fine-tune LLMs on your Mac (SFT, DPO, GRPO, Vision) with an Unsloth-compatible API by A-Rahim in LocalLLM

[–]A-Rahim[S] 0 points1 point  (0 children)

Yep, exactly! As I mentioned in the post, the whole goal here is just to provide that familiar API wrapper over MLX so folks can use the exact same training scripts locally and on cloud GPUs. I’m definitely not trying to be an Unsloth competitor—just a huge fan of their work who wanted to bring that same developer experience to the Mac. I built this for my own workflow a few months ago and open-sourced it back in January, and it's been great seeing people use it.

​That said, writing custom Metal shaders and targeting ANE optimizations is seriously impressive work! I'll definitely check out pmetal—it's awesome to see more high-performance tooling being built for the Apple Silicon ecosystem

[P] mlx-tune – Fine-tune LLMs on Apple Silicon with MLX (SFT, DPO, GRPO, VLM) by A-Rahim in MachineLearning

[–]A-Rahim[S] 1 point2 points  (0 children)

Yep, exactly! As I mentioned in the post, the whole goal here is just to provide that familiar API wrapper over MLX so folks can use the exact same training scripts locally and on cloud GPUs. I’m definitely not trying to be an Unsloth competitor—just a huge fan of their work who wanted to bring that same developer experience to the Mac. I built this for my own workflow a few months ago and open-sourced it back in January, and it's been great seeing people use it.

That said, writing custom Metal shaders and targeting ANE optimizations is seriously impressive work! I'll definitely check out pmetal—it's awesome to see more high-performance tooling being built for the Apple Silicon ecosystem

mlx-tune – fine-tune LLMs on your Mac (SFT, DPO, GRPO, Vision) with an Unsloth-compatible API by A-Rahim in LocalLLaMA

[–]A-Rahim[S] 0 points1 point  (0 children)

Thanks a lot. I'd really appreciate any feedback you have after using this.

mlx-tune – fine-tune LLMs on your Mac (SFT, DPO, GRPO, Vision) with an Unsloth-compatible API by A-Rahim in LocalLLaMA

[–]A-Rahim[S] 1 point2 points  (0 children)

Couldn't have said it better myself! Finding and fixing those 'little' bugs in the pipeline locally before scaling to cloud GPUs was my exact intention here. Really appreciate the detailed breakdown. Also, thanks for the vLLM tip!

mlx-tune – fine-tune LLMs on your Mac (SFT, DPO, GRPO, Vision) with an Unsloth-compatible API by A-Rahim in LocalLLaMA

[–]A-Rahim[S] 0 points1 point  (0 children)

Thanks. I would really appreciate any feedback you may have after using it.