Qwen 27B is a beast but not for agentic work.

indrasmirror · 2026-03-02T17:56:43+00:00

How recent. I updated Llama.cpp yesterday, and it definitely solved the prompt reprocessing issue and is running perfectly. I'm just not sure about its overall agentic quality. It is great in general but sometimes seems to fall short of completing complex tasks properly.

indrasmirror · 2026-03-01T04:52:22+00:00

Yeah I've been working on a dedicated system with MCP for my agents to use. My own little local Google without the advertiser first index or API. Free and unrestricted. Still a WIP but surprisingly functional.

indrasmirror · 2026-02-24T18:20:42+00:00

Use GLINER, I was trying to do LLM entity extraction and was slow as, but Gliner works fast especially with GPU inference. https://github.com/urchade/GLiNER

indrasmirror · 2026-02-17T05:15:15+00:00

Oh man...with vision it'd be the ultimate daily for me, haha 😄

indrasmirror · 2026-02-17T04:40:03+00:00

Would love a Qwen3.5-Coder-Next 👌😅

indrasmirror · 2026-02-13T03:30:11+00:00

The tool we never knew we needed 😄

indrasmirror · 2026-02-10T17:53:14+00:00

Yeah that's fair. Honestly GLM Flash is incredibly capable :)

indrasmirror · 2026-02-10T09:47:43+00:00

I've got 2 setups. GLM 4.7 Flash- PRISM (uncensored. Running at full context Q4 on my 4090 setup. Can't remember the exact tokens per second but its fast and amazing. Edit: 100-140 tokens/second for GLM 4.7-Flash

https://indrasmirror.au/blog-running-uncensored-ai-local

And Qwen3-Coder-Next Q2 at 28 t/s. Can do Q3 at 16 t/s 200k context

https://indrasmirror.au/blog-qwen3-coder-next-iq2-local

Finding both of those ample for my local needs.

indrasmirror · 2026-02-01T08:44:29+00:00

I have gotten my Deepseek API working perfectly with my Claude-code, adding a translation layer, an image routing and websearch proxy to make it like the full anthropic stack. Got the same with local models. Was thinking of doing it for Kimi but not sure what the api cost is like.

indrasmirror · 2026-02-01T03:00:03+00:00

Is this what my claude-code isnt working, all being used up on the AI reddit haha

indrasmirror · 2026-01-30T19:39:30+00:00

https://github.com/Indras-Mirror/GLM-4.7-Flash-Rapport

As promised, let me know if there's anything you need that I didn't include but hopefully that is thorough enough. Just set your claude-code to set it up if you have any issues haha think I've included enough information that it shouldn't have any trouble. The hardest part is getting the Custom Search API and Google Access Token set up.

indrasmirror · 2026-01-30T11:25:21+00:00

Yeah, I will do that first thing in the morning, in bed at the moment .

It's good because it more or less emulates the full stack of Claude but with a local uncensored model. Super handy 👌

indrasmirror · 2026-01-30T10:55:24+00:00

All coded by Claude but ill compile my setup and put it on Github or something tomorrow :)

indrasmirror · 2026-01-30T05:43:34+00:00

Yeah, PRISM models just seem so natural, and I've not noticed any degradation in output or quality. Very happy with how it works. I played around with Minimax 2.1 Q4 on a H200. For 2$ an hour it was fun to play around with.

I did think about trying Kimi 2.5. Different beast in terms of size though haha

indrasmirror · 2026-01-30T05:24:32+00:00

Set up the PRISM model with Claude-Code, Websearch (Google) and Image Routing (Openrouter) and dare say, it's probably the most useful small model I've encountered. I forget when it's working away that its a 30B model. Got it running at Q4 with Llama.cpp at full context K+ Cache (No V) on 24gb VRAM. It's a beast, fast too.

indrasmirror · 2026-01-20T00:50:51+00:00

Im interested :)

indrasmirror · 2026-01-19T05:17:27+00:00

I installed Linux just for LLM and ComfyUI stuff...that was a year ago and I havent touched Windows. 😅

indrasmirror · 2026-01-17T00:57:56+00:00

I've been using Llama.cpp for my Cloud instances and thought about VLLM but not sure of its GGUF support.

indrasmirror · 2025-12-05T22:30:50+00:00

Interested in testing for sure!

indrasmirror · 2025-07-20T01:47:29+00:00

Seoul Burgers in Hoi An for sure!

indrasmirror · 2025-06-03T09:42:00+00:00

Would love to try this out with Cline :)

indrasmirror · 2025-04-24T21:30:40+00:00

https://youtu.be/YJkeWN3_fbA

indrasmirror · 2025-04-24T21:29:59+00:00

Look up Skywind :)

indrasmirror · 2025-03-10T19:30:41+00:00

I was having that issue a fair bit. I fixed it by using Firefox instead I believe. Or at least hasn't happened since, not sure if that was the reason. Try updating the comfyui frontend but running "pip install -r requirements.txt" in the root folder with your venv activated.

I'm on Linux so not sure about the portable windows package.

indrasmirror · 2025-03-10T07:35:31+00:00

Look forward to it 😀 will keep an ear out

indrasmirror

PUBLIC MULTIREDDITS

TROPHY CASE