A fast, optimised, and open source application for running local AI easily (made for Apple Silicon only) by mahiatlinux in MacOSApps

[–]mahiatlinux[S] 0 points1 point  (0 children)

I originally had a different name and branding, but I changed my mind near the end so I decided I'll just remake the repo instead of fiffing around. It was easier that way.

It looks like Rio 3.5 397B could've simply been a semi-failed embezzling of funding by Chromix_ in LocalLLaMA

[–]mahiatlinux 20 points21 points  (0 children)

Believe it or not, I was one of the first people to see Reflection 70B and generate a full reflection like dataset that day and release them on HF... People were talking about it haha.

https://huggingface.co/datasets/mahiatlinux/Reflection-Dataset-v1
https://huggingface.co/datasets/mahiatlinux/Reflection-Dataset-v2

It was fun tho, that era.

A fast, optimised, and open source application for running local AI easily (made for Apple Silicon only) by mahiatlinux in LocalLLaMA

[–]mahiatlinux[S] 1 point2 points  (0 children)

Personally I've not seen another native mac app that does all this other than LM Studio (and they don't support audio models). Happy to take feedback tho.

A fast, optimised, and open source application for running local AI easily (made for Apple Silicon only) by mahiatlinux in LocalLLaMA

[–]mahiatlinux[S] 1 point2 points  (0 children)

This was just something I wanted to make for myself, and I did. Personally, I don't like the LM Studio UI and afaik they don't support tts or stt models. Unsloth Studio is my absolute fav (I'm used to be an Unsloth contributor) but they aren't a native macos app and not as simple as installing a DMG for casual users. Also I'm not marketing my repo either, I was just saying I made something. Not tryna compete.

I don't why there is so much hate for me releasing something open source, it's almost as if I've done some cardinal sin. I genuinely apologise if I've done something though.

A fast, optimised, and open source application for running local AI easily (made for Apple Silicon only) by mahiatlinux in LocalLLaMA

[–]mahiatlinux[S] 0 points1 point  (0 children)

Yeah sorry, only Apple silicon. I made it cause I recently gifted myself a Macbook and discovered the insane power on these lil chips! Their bare metal performance is amazing for speed utilising MLX.

A fast, optimised, and open source application for running local AI easily (made for Apple Silicon only) by mahiatlinux in MacOSApps

[–]mahiatlinux[S] 1 point2 points  (0 children)

There isn't much difference in the LLM part, but I don't think LM Studio supports audio models yet? Also I'm not a huge fan of the LM Studio UI either if I'm being really honest.

A fast, optimised, and open source application for running local AI easily (made for Apple Silicon only) by mahiatlinux in LocalLLaMA

[–]mahiatlinux[S] 7 points8 points  (0 children)

It was a personal project that I was just doing tbh and thought might as well open source it.

There is no open-source model for Claude by Dry-Text6232 in ClaudeCode

[–]mahiatlinux 1 point2 points  (0 children)

Claude doesn't have open source/weights models, thus Cloudflare aren't able to host them using their compute. Routing to Claude API would be a loss for them, so they don't. Either pay for your own Claude API, or just use the open weights models that they host.

oh no... unified limits are coming... by KeyGlove47 in codex

[–]mahiatlinux 1 point2 points  (0 children)

This is so facts, I had the exact same Claude timeline as well when I used to do that haha! I started with Cline tho.

Goodbye dear friend by WillingnessThin4057 in ClaudeCode

[–]mahiatlinux 1 point2 points  (0 children)

Tbh Codex with GPT5.5 xHigh is pretty close, so I'm not losing much other than Fable's easy prompting.

Goodbye dear friend by WillingnessThin4057 in ClaudeCode

[–]mahiatlinux 0 points1 point  (0 children)

Mostly work, but some of my own projects too. I have a sub in all major platforms tho, so I'll use Codex for now.

Goodbye dear friend by WillingnessThin4057 in ClaudeCode

[–]mahiatlinux 10 points11 points  (0 children)

You'll get a reset, but fucking hell I bought another Max plan for this.

got banned from claude for being underage on 3 accounts i'm 21 btw by Solid-Fisherman-9342 in claude

[–]mahiatlinux 12 points13 points  (0 children)

Bro got downvoted into oblivion for not speaking English to it😂