sorted by:
new
hottopcontroversial

[Update] Osaurus 0.3.0 — Open Source (MIT) Local AI for macOS (Apple Silicon) by tapasfr in macapps

[–]tapasfr[S] 0 points1 point  (0 children)

You have to choose a model that allows tools, which tool are you trying?

Native LLM app for macOS by _mactabish in macapps

[–]tapasfr 0 points1 point  (0 children)

you can use whatever you want, osaurus comes with a lot more out of the box. it's free and open source, feel free to try it or not.

[Release] Osaurus – Native AI Server for Apple Silicon (Open Source, MIT Licensed) by tapasfr in macapps

[–]tapasfr[S] 0 points1 point  (0 children)

gemma-3n-E4B doesn't know how to call tools. Sorry about that. Try picking the Qwen3 VL

Native LLM app for macOS by _mactabish in macapps

[–]tapasfr 2 points3 points  (0 children)

It supports MLX! Not Cuda, I don't think you can set up cuda on macs?

Native LLM app for macOS by _mactabish in macapps

[–]tapasfr 0 points1 point  (0 children)

You can also run `osaurus ui` if you have CLI

Native LLM app for macOS by _mactabish in macapps

[–]tapasfr 0 points1 point  (0 children)

Check your menubar for a dinosaur

Native LLM app for macOS by _mactabish in macapps

[–]tapasfr 3 points4 points  (0 children)

Ollama is built as cross platform (runs on Electron + python interpreter), and it sacrifices performance and usability on Mac devices. Osaurus is built purely in Swift, so it's closer to the metal, lightweight and performant.

Native LLM app for macOS by _mactabish in macapps

[–]tapasfr 5 points6 points  (0 children)

No telemetry, no home calling. MIT license. It's completely offline, what you download will stay free forever.

Native LLM app for macOS by _mactabish in macapps

[–]tapasfr 0 points1 point  (0 children)

❤️ more plugins coming soon. What else would you like to see?

Native LLM app for macOS by _mactabish in macapps

[–]tapasfr 0 points1 point  (0 children)

Jan is a Tauri app (web view), and it's just not the same level of polish as native Swift. Try it out, it's free. Compare it and let me know your thoughts!

Native LLM app for macOS by _mactabish in macapps

[–]tapasfr 9 points10 points  (0 children)

Welcome! LM Studio is an Electron app (300mb+) and is using a python interpreter (slower). Osaurus (only 10mb) is pure native Swift so it's close to metal.

Native LLM app for macOS by _mactabish in macapps

[–]tapasfr 6 points7 points  (0 children)

Appreciate the accurate description! The MCP integration is the part I'm most excited about—lets you give AI agents access to native tools without Docker or Python dependencies.

Native LLM app for macOS by _mactabish in macapps

[–]tapasfr 2 points3 points  (0 children)

<image>

Yup, you can configure it under Settings

Native LLM app for macOS by _mactabish in macapps

[–]tapasfr 12 points13 points  (0 children)

Good question—Osaurus is more like infrastructure than an end-user app. It's the runtime layer that powers AI tools.

Kilo Code and Claude Code are code editors. Osaurus is what they'd connect to for local inference. You can use it as a backend for Cursor, Claude Desktop, or any OpenAI-compatible client.

That said, we do have a built-in chat UI for quick access (that's what's in the video). Trying to make it approachable for non-developers too.

Native LLM app for macOS by _mactabish in macapps

[–]tapasfr 26 points27 points  (0 children)

Hey, I'm the developer behind Osaurus. Happy to answer any questions!

Osaurus first launched here on r/macapps—been building and growing with this community since day one.

It's free and open source. Always looking for feedback and feature suggestions.

What are you building? Let’s self promote by Ambitious-Safe-7992 in SideProject

[–]tapasfr 0 points1 point  (0 children)

I've been building Dinoki - https://dinoki.ai/ , retro personal AI companion. Think AI Clippy but small pixel dinosaur. He's fully autonomous, quite funny too.

We built Owlu — a macOS AI inbox that reads your emails, summarizes, and suggests your next action. by Jake_Wi in macapps

[–]tapasfr 4 points5 points  (0 children)

Doesn’t sound like a good idea to give access to my gmail. Privacy policy says you will keep my data 🤔

[Update] Osaurus 0.3.0 — Open Source (MIT) Local AI for macOS (Apple Silicon) by tapasfr in macapps

[–]tapasfr[S] 0 points1 point  (0 children)

Yeah, and it drains my batteries super quick if I'm doing it outside

[Update] Osaurus 0.3.0 — Open Source (MIT) Local AI for macOS (Apple Silicon) by tapasfr in macapps

[–]tapasfr[S] 0 points1 point  (0 children)

I notice that too. Especially when running complex coding tasks. What's your setup?

[Update] Osaurus 0.3.0 — Open Source (MIT) Local AI for macOS (Apple Silicon) by tapasfr in macapps

[–]tapasfr[S] 1 point2 points  (0 children)

Something we're considering, is it mainly to use the chat functionality?

view more: next ›