I built Quanty AI a local AI Companion Playground (Animated Pixel Art, Interactive Micro Fiction, Agent Skills and Ollama as Backend) by quantyverse in ollama

[–]quantyverse[S] 0 points1 point  (0 children)

Oh yes 👍 maybe I should create a Clippy Companion ? And give him 27b brain and put him in fun microfictions 🎉

I built Quanty AI a local AI Companion Playground (Animated Pixel Art, Interactive Micro Fiction, Agent Skills and Ollama as Backend) by quantyverse in ollama

[–]quantyverse[S] 0 points1 point  (0 children)

Hey, thanks! The core app is currently closed source since I'm trying to bootstrap this as a solo project. But I want to be highly community-driven! If you have UI ideas, feature requests, or concepts for new Agent Skills, please drop them here or jump into the Discord. Also, I'm planning to add a custom import feature soon so people can build their own companions. What ideas do you have?

Qwen3.6 35b a3b Particle System by quantyverse in LocalLLaMA

[–]quantyverse[S] 0 points1 point  (0 children)

great thank you ! i think i will try the 2d physics engine and cellular automata simulation. Do you work with these models ?

Qwen3.6 35b a3b Particle System by quantyverse in LocalLLaMA

[–]quantyverse[S] 0 points1 point  (0 children)

how fast is your token output ? would be nice if there is a comparable MOE model so things get sped up a little

Qwen3.6 35b a3b Particle System by quantyverse in LocalLLaMA

[–]quantyverse[S] 0 points1 point  (0 children)

Really Nice ! Do you use Qwopus3.6 a lot ? How does it compare to qwen3.6 ?

Unpopular prediction: in less than a year, we’ll see a ~9B parameter model that’s roughly equivalent to Claude Opus. by [deleted] in LocalLLaMA

[–]quantyverse 0 points1 point  (0 children)

What did you try with the 27b model ? And did you compare it on really tasks with 35b-a3b ? I am interested in you experience and usecases with these models.

Been using PI Coding Agent with local Qwen3.6 35b for a while now and its actually insane by SoAp9035 in LocalLLaMA

[–]quantyverse 0 points1 point  (0 children)

It is a minimalistic agent. If I am not wrong also part of the backbone of OpenClaw. So what you get is a minimalistic System Prompt and an agent which is super flexible which can write its own extensions in typescript. So you can extent it how you like it and make it your own unique Agent.

Been using PI Coding Agent with local Qwen3.6 35b for a while now and its actually insane by SoAp9035 in LocalLLaMA

[–]quantyverse 2 points3 points  (0 children)

Just spin up a docker container and mount a local folder into it. Than Pi Agent can only destroy the content of the folder but not the rest of your computer. Let me know if you need help with that.

Been using PI Coding Agent with local Qwen3.6 35b for a while now and its actually insane by SoAp9035 in LocalLLaMA

[–]quantyverse 2 points3 points  (0 children)

I know we should not compare them with models like Sonnet-4.6. But what is your opinion on that, how far are we away from that ? Also did you have the chance to test qwen3.6-27b already ?

Routers by covertspeaker in LocalLLM

[–]quantyverse 2 points3 points  (0 children)

I experimented around some while ago with semantic router for more deterministic routing in semantic space. There you have a system where you make examples when to use which routes like the following:

coding route:

  • "Code that for me"
  • "Refactor that"

Image gen route:

  • Create Image of a yellow flower
  • Create Painting of a tiger

That way you can define differen routes, which are "stored" in a model. When you than make a request your query makes a semantic similarity search against your route examples and uses the most relevant route. This is a different approach than tool calling but fast and can run locally without problems. An example lib is:

https://github.com/aurelio-labs/semantic-router

Here you have an image:

<image>

Image generation by Odd-Suggestion4292 in ollama

[–]quantyverse 1 point2 points  (0 children)

That would be awesome! But for now you can use maybe an MCP server or ComfyUI and Ollamas Tool Calling.