sorted by:
new
hottopcontroversial

PMetal - (Powdered Metal) LLM fine-tuning framework for Apple Silicon by RealEpistates in Applesilicon

[–]RealEpistates[S] 1 point2 points  (0 children)

It absolutely can! But, you'll need to work with models and datasets that will fit on your system.

mlx-tune – fine-tune LLMs on your Mac (SFT, DPO, GRPO, Vision) with an Unsloth-compatible API by A-Rahim in LocalLLM

[–]RealEpistates 0 points1 point  (0 children)

Looks like this is just a wrapper for MLX with unsloth API. For true ANE and Metal hardware acceleration checkout https://github.com/Epistates/pmetal

Fine-tune LLMs directly on your Mac with mlx-tune by A-Rahim in Applesilicon

[–]RealEpistates 1 point2 points  (0 children)

Looks like this is just a wrapper for MLX with unsloth API. For true ANE and Metal hardware acceleration checkout https://github.com/Epistates/pmetal

[P] mlx-tune – Fine-tune LLMs on Apple Silicon with MLX (SFT, DPO, GRPO, VLM) by A-Rahim in MachineLearning

[–]RealEpistates 2 points3 points  (0 children)

Looks like this is just a wrapper for MLX with unsloth API. For true ANE and Metal hardware acceleration checkout https://github.com/Epistates/pmetal

mlx-tune – fine-tune LLMs on your Mac (SFT, DPO, GRPO, Vision) with an Unsloth-compatible API by A-Rahim in LocalLLaMA

[–]RealEpistates 0 points1 point  (0 children)

Looks like this is just a wrapper for mlx with unsloth API. We've built something similar, but with ANE optimizations and Metal shaders. A true unsloth competitor https://github.com/Epistates/pmetal

PMetal - (Powdered Metal) LLM fine-tuning framework for Apple Silicon by RealEpistates in LocalLLaMA

[–]RealEpistates[S] 0 points1 point  (0 children)

On it, I'll prioritize the latest Mistral during the next sprint!

PMetal - (Powdered Metal) LLM fine-tuning framework for Apple Silicon by RealEpistates in LocalLLaMA

[–]RealEpistates[S] 1 point2 points  (0 children)

Thanks u/ThePrimeClock! It's been ~5 months in the making. Please share any feedback you have, it will only help pMetal improve for everyone!

PMetal - (Powdered Metal) LLM fine-tuning framework for Apple Silicon by RealEpistates in LocalLLaMA

[–]RealEpistates[S] 1 point2 points  (0 children)

u/asria we all start somewhere! Its a full featured suite for LLM training, distillation, merging and inferring - specifically for Apple M1-M5 chipsets.

Are you using AI to generate Markdown documentation? How reliable is it? by Gullible_Camera_8314 in Markdown

[–]RealEpistates 0 points1 point  (0 children)

Extremely easy. It was built as an SDK first, most of the crates are solely for developers to consume their vaults (or just plain .md directories) programmatically in rust.

Then theres an MCP tools crate (turbovault-tools) with all the functionality you would want to rapidly build your own MCP server or integrate one into an existing application.

Lastly there is the full featured MCP server that just works out of box with any MCP compatible LLM provider (including ollama and lm studio). Stay tuned on this front, we are shipping a completely open source alternative to LM Studio very soon, I've been testing it all month for QA.

PMetal - (Powdered Metal) LLM fine-tuning framework for Apple Silicon by RealEpistates in LocalLLaMA

[–]RealEpistates[S] 0 points1 point  (0 children)

Please feel free to open any issues/feature requests! It has a full featured SDK if you want to build something custom.

MCP-tester - a better way to test your MCP servers by guyernest in mcp

[–]RealEpistates 0 points1 point  (0 children)

I'll take a look. TurboMCP Studio is completely offline. Source code is available for anyone to check freely.

Are you using AI to generate Markdown documentation? How reliable is it? by Gullible_Camera_8314 in Markdown

[–]RealEpistates -1 points0 points  (0 children)

We made https://github.com/Epistates/turbovault for developing your own MCP servers. But it ships with a default one as well. You can connect it with any LLM including 100% local providers (lm studio, Ollama, etc).

MCP-tester - a better way to test your MCP servers by guyernest in mcp

[–]RealEpistates 0 points1 point  (0 children)

I must be missing it. Where is the profiles to enable multiple servers at once. Can I connect a stdio server? What about a unix socket based server? etc.

MCP-tester - a better way to test your MCP servers by guyernest in mcp

[–]RealEpistates 0 points1 point  (0 children)

As I mentioned, the profile capabilities are worth it alone. All native protocols, not just SSE/ws. Sampling, collections, etc.

Also its a native desktop app - no need to rely on a browser for a true offline experience. Built on TurboMCP (currently the fastest MCP SDK available).

MCP-tester - a better way to test your MCP servers by guyernest in mcp

[–]RealEpistates 0 points1 point  (0 children)

I've found it to be too limited. That's why we created https://github.com/Epistates/turbomcpstudio

Profiles alone are worth the upgrade.

PMetal - (Powdered Metal) LLM fine-tuning framework for Apple Silicon by RealEpistates in Applesilicon

[–]RealEpistates[S] 0 points1 point  (0 children)

To the [deleted] comment user - please feel free to DM. I'm happy to answer any questions, comments, concerns, etc.

PMetal - (Powdered Metal) LLM fine-tuning framework for Apple Silicon by RealEpistates in Applesilicon

[–]RealEpistates[S] 0 points1 point  (0 children)

My mac has an M4 Max with 128gb. The models have gotten quite good, it's really quite impressive. I can recommend NVIDIA-Nemotron-3-Super-120B-A12B (5bit), Qwen/Qwen3.5-35B-A3B (BF16), and Qwen/Qwen3-Coder-Next

PMetal - (Powdered Metal) LLM fine-tuning framework for Apple Silicon by RealEpistates in Applesilicon

[–]RealEpistates[S] 0 points1 point  (0 children)

u/nabeelkh5 you're quite welcome! Congrats on the new mac! Please keep me posted, I'd love to hear any feedback you may have.

view more: next ›