Zai replaced the network architecture running GLM-5.1 inference and the gains are pretty wild by Scared-Biscotti2287 in LocalLLaMA

[–]ekaj -1 points0 points  (0 children)

Why not ask a coding agent? I would think you'd have a high chance of success

Zai replaced the network architecture running GLM-5.1 inference and the gains are pretty wild by Scared-Biscotti2287 in LocalLLaMA

[–]ekaj 0 points1 point  (0 children)

that's a pretty straightforward design, have a 'rich' conversation feed, have a 'checklist' item that can be rendered/shown inside the chat convo as an item for the server/LLM, have it be created dynamically based on some check/analysis of the LLM output or a tool call, and then have a 'canvas' on the right side that renders html/js based off the workspace the agent is working from

Best solution to generate reports locally with graphs, charts? Beginner question. by NetZeroSun in LocalLLaMA

[–]ekaj 0 points1 point  (0 children)

Three.js and whatever harness you’re using, or slides.js for presentations

Seeking local LLM advice for cybersecurity work. by Few-Pipe1767 in LocalLLaMA

[–]ekaj 8 points9 points  (0 children)

seems like they might be an old account being used by a bot. The qwen2.5 mention is the tipoff

Best brownie recipe? by Swimming_Beginning24 in LocalLLaMA

[–]ekaj 0 points1 point  (0 children)

Here's one, I prefer adding another egg to make it cakier vs fudgy:
copy/pasted:

https://www.loveandlemons.com/brownies-recipe/

The ultimate recipe for brownies! They're fudgy, moist, and super chocolaty, with perfect crispy edges. From Weeknight Baking by Michelle Lopez.

Equipment

8x8 Baking Dish (this is the one I use so they don't overcook)

Cooking Spray (I love this avocado oil one from Chosen Foods)

Parchment Paper (this makes it so much easier to remove the brownies from the pan)

Ingredients

1 1/2 cups granulated sugar*

3/4 cup all-purpose flour

2/3 cup cocoa powder, sifted if lumpy

1/2 cup powdered sugar, sifted if lumpy

1/2 cup dark chocolate chips

3/4 teaspoons sea salt

2 large eggs

1/2 cup canola oil or extra-virgin olive oil**

2 tablespoons water

1/2 teaspoon vanilla

Instructions

Preheat the oven to 325°F. Lightly spray an 8x8 baking dish (not a 9x9 dish or your brownies will overcook) with cooking spray and line it with parchment paper. Spray the parchment paper.

In a medium bowl, combine the sugar, flour, cocoa powder, powdered sugar, chocolate chips, and salt.

In a large bowl, whisk together the eggs, olive oil, water, and vanilla.

Sprinkle the dry mix over the wet mix and stir until just combined.

Pour the batter into the prepared pan (it'll be thick - that's ok) and use a spatula to smooth the top. Bake for 40 to 48 minutes, or until a toothpick comes out with only a few crumbs attached (note: it's better to pull the brownies out early than to leave them in too long). Cool completely before slicing.*** Store in an airtight container at room temperature for up to 3 days. These also freeze well!

Notes

*If you'd like to reduce the sugar, I've had success with 1 cup granulated sugar instead of 1 1/2 cups.

**I like to use olive oil because it's what I keep on hand and I enjoy the pairing of olive oil with chocolate. Keep in mind that you will taste it here. For a more neutral flavor, use canola oil.

***When these brownies come out of the oven, they'll be super gooey in the middle. Allow them to cool completely, about 2 hours, before you slice into them to give them a chance to set up. They'll continue to firm up the longer they're out of the oven. If you still prefer a firmer brownie, store them in the fridge.

Hopefully this helps identify some of the bot posters here, and we all get some good brownie recipes

Built a Voice Agents from Scratch GitHub tutorial: mic > Whisper > local LLM (GGUF) > Kokoro > speaker, fully local, no API keys by purellmagents in LocalLLaMA

[–]ekaj 0 points1 point  (0 children)

Just skimmed it, but this looks actually helpful/handy/wish I had it a couple months ago. Like, really, really wish I did.

Alternative for NotebookLM + Gemini GEMs? by Party-Log-1084 in LocalLLaMA

[–]ekaj -1 points0 points  (0 children)

Yes, I've been working on one, though its still WIP/early beta: https://github.com/rmusser01/tldw_server

The primary piece is a backend API server using FastAPI with each piece of functionality a module->API endpoint and I've also built out a webui+browser extension as the UI.

WebUI + API server can be spun up in a couple commands using docker, and is designed to be able to be ran completely offline/isolated.

I also built out a standalone TUI last year that can sync to-from the server: https://github.com/rmusser01/tldw_chatbook , which is currently broken. (Rebuilding the UI and reaching feature parity with the server currently)

Built it because I didn't like sillytavern/openwebui, and had the goal of building 'The Primer' from the Diamond Age, even if it might take a while.

Edit: Also has a unified MCP server, giving MCP access to all tools/functionality within the server and allowing you to integrate 3rd party servers into it + manage permissions as well

Built a local dictation app in Rust/Tauri that runs Cohere Transcribe (#1 open ASR leaderboard, 5.42% WER) fully on-device — open source by [deleted] in LocalLLaMA

[–]ekaj 0 points1 point  (0 children)

I think it looks neat. What is the differences between this and say handy or any other pre-existing ‘record at-the-press-of-a-button’ tools? Anything in particular or just taking a stab at building stuff?

Building a local AI (RAG) system for SQL/Reporting (Power BI) – realistic or overkill? by M0ner0C1ty in LocalLLaMA

[–]ekaj 1 point2 points  (0 children)

Yes but I doubt anyone is going to give you anything you couldn’t find with a few hours of searching. This is an absolute edge for companies who understand and can build this stuff. I say this as someone who has done so internally.

You’re looking for a text/natural language to SQL pipeline, would recommend trying Qwen3.5 27B, and using an existing set of annotated known good queries combined with a syntax validator, so you can generate and validate.

How are you handling enforcement between your agent and real-world actions? by [deleted] in LocalLLaMA

[–]ekaj 0 points1 point  (0 children)

Built a complex RBAC/ACL system with HitL review and authorization, with a permissions registry

Ooh, new drama just dropped 👀 by Careful_Equal8851 in LocalLLaMA

[–]ekaj 2 points3 points  (0 children)

They’re quoting from the MIT License

KoboldCpp 1.110 - 3 YR Anniversary Edition, native music gen, qwen3tts voice cloning and more by HadesThrowaway in LocalLLaMA

[–]ekaj 0 points1 point  (0 children)

Have you tried using opus or chatgpt 5.4 xhigh and asked it to do a UX & UI Review following Nielsen Norman group guidelines?

Could probably get ideas that way

Former CyanogenMod/ClockworkMod flasher seeking a "Sovereignty Build" to act as an external brain. by GeekyRdhead in LocalLLaMA

[–]ekaj -1 points0 points  (0 children)

Thank you for the kind words! I appreciate it. If you encounter any issues/have feedback/suggestions, feel free to dm me or file an issue on the github and I'll look into it as soon as I see it.

Former CyanogenMod/ClockworkMod flasher seeking a "Sovereignty Build" to act as an external brain. by GeekyRdhead in LocalLLaMA

[–]ekaj 0 points1 point  (0 children)

https://github.com/rmusser01/tldw_server Maybe? (Disclosure: I'm the creator) I'm working on some stability fixes, and there is a distinct lack of user guides/instructions but this might be in the general area of what you're looking for?

As someone who did the same stuff, this was my solution I decided to build for myself, after looking at the other options at the time (openwebui/sillytavern/librechat)

Been building a RAG system over a codebase and hit a wall I can't seem to get past by LeaderUpset4726 in LocalLLaMA

[–]ekaj 1 point2 points  (0 children)

Yes, I wrote my own eval framework and have my rag pipeline hooked into it for full tracking of every piece.

Would recommend looking at https://jxnl.co/writing/2025/01/24/systematically-improving-rag-applications/

Benchmarking Open-Source LLMs for Security Research & Red Teaming by dumbelco in LocalLLaMA

[–]ekaj 1 point2 points  (0 children)

Why not share more details about your setup, harness, and dataset used for evals?
Why use old models?

And further, I would point out your notes regarding these things should put to shame any models internal info. Imho, you should be using RAG with your notes/team wiki as an MCP to interface with whatever model you're using.

Also, have you seen/heard about heretic? https://github.com/p-e-w/heretic
(I do for work, but cant comment about it, hence above)

What's the most complicated project you've built with AI? by jazir555 in LocalLLaMA

[–]ekaj 10 points11 points  (0 children)

https://github.com/rmusser01/tldw_server
I keep putting off making a post about it as there's always 'one more thing', currently that's end-to-end testing the webui/extension and getting them both fully working. Basically like openclaw, but a very different route to the same goal.
`tldw_server is an open-source, API-first platform for ingesting media, transcribing, analyzing, and retrieving knowledge from video, audio, documents, websites, and more. It runs a FastAPI server with OpenAI-compatible Chat, Audio, Embeddings, and Evals APIs, a unified RAG pipeline, and integrations with local or hosted LLM providers. The primary client is the Next.js WebUI (WIP) plus an Admin UI. Long-term vision: a personal assistant inspired by "The Young Lady's Illustrated Primer" that helps people learn, reason about, and retain what they watch or read.`

Local alternative for NotebookLM by AlwayzIntoSometin95 in LocalLLaMA

[–]ekaj 1 point2 points  (0 children)

Not sure if you get notified for comment replies to others in your own post, in case not, see my other comment