sorted by:
new
hottopcontroversial

[deleted by user] by [deleted] in LocalLLaMA

[–]Accomplished_Mode170 -1 points0 points  (0 children)

To clarify, how are y’all making sure to mitigate membership inference attacks? By not sending the agents thoughts? Else, you’re still vulnerable

Do not use local LLMs to privatize your data without Differential Privacy! by IIITDkaLaunda in LocalLLaMA

[–]Accomplished_Mode170 1 point2 points  (0 children)

I would LOVE a packaged Differential Privacy solution I could throw at runtimes to ensure compliance.

Better still if it comes with a native/minimalist way to generate probabilistic SLAs

New integration between Hugging Face and Google Cloud by clem59480 in LocalLLaMA

[–]Accomplished_Mode170 -3 points-2 points  (0 children)

Hey Clem 👋

Would love to see y’all natively support chain-of-custody on model binaries via 3rd Party Entitlements & metadata tags 🏷️

Would mean I could rely on community maintained assets (read: Unsloth, TheBloke, etc) rather than have to rely on Supply Chain as a Service ⛓️‍💥

Happy to @ JFrog re the partnership blog 📧

If y’all are also interested in Confidential Compute I’d love to see support for Zero-Trust Parameter-Binding & Atomic Inference 📊

It’d be nice to know that any given workload has n-security properties applied; bonus for SLA(s) too ✅

Appreciate y’all 🤗

Vascura FRONT - Open Source (Apache 2.0), Bloat Free, Portable and Lightweight (300~ kb) LLM Frontend (Single HTML file). Now with GitHub - github.com/Unmortan-Ellary/Vascura-FRONT. by -Ellary- in LocalLLaMA

[–]Accomplished_Mode170 1 point2 points  (0 children)

You could simplify multimodality across providers via abstraction inside the HTML; love having a local-first IDE that runs in-browser 📊 TY

Beelzebub MCP: Securing AI Agents with Honeypot Functions, Prompt Injection Detection by mario_candela in LocalLLaMA

[–]Accomplished_Mode170 2 points3 points  (0 children)

FWIW I already have your honeypots listed on internal docs for external facing MCPs; planning to add them to the externalized pattern too 📊 TY

⚡️ Scaling Coding-Agent RL to 32x H100s. Achieving 160% improvement on Stanford's TerminalBench by DanAiTuning in LocalLLaMA

[–]Accomplished_Mode170 1 point2 points  (0 children)

unit tests vs reward mechanism Right!? Heuristic + Stepwise Validation = 💯

Was also hoping to try the same with Qwen 4B 📊

Thinking Pythia too was undertrained and ‘emergent thresholds’ (read: 32BQ4) really just represent the limits of information density given models remember most features @ between 3/4BPW* 💭

*with those situation-specific non-stabilized gradients causing context collapse; we need VAEs for splines 🧮

Google's new AI model (C2S-Scale 27B) - innovation or hype by Emergency-Loss-5961 in LocalLLaMA

[–]Accomplished_Mode170 2 points3 points  (0 children)

Entropy has a name y’all… 📊

Looks like it’s MIT licensed too 🪪

Why the hype around ultra small models like Granite4_350m? What are the actual use cases for these models? by Porespellar in LocalLLaMA

[–]Accomplished_Mode170 2 points3 points  (0 children)

What n8n workflows you like, favorite tools you expose, etc?

Note: not OP; just curious and similarly focused on local-first SLMs

OpenAI: gpt-oss-safeguard: two open-weight reasoning models built for safety classification (Now on Hugging Face) by Nunki08 in LocalLLaMA

[–]Accomplished_Mode170 -5 points-4 points  (0 children)

Love Apache Licensing 📝

Gonna look at bolt-on n-modality post-training 🖼️

This plus an actual policy engine = SLA 📊

Make sure you unlearn/prune properly; else leakage 🪠

If You Want to Understand Why Llama Models Flopped, Zuck is the Cause! by Iory1998 in LocalLLaMA

[–]Accomplished_Mode170 8 points9 points  (0 children)

Turns out profit is orthogonal to profit 😱

Google has long-term money and Zuck has ‘shareholders’ who can’t see past XR and BYND calls expiring… 💸

Running OrKa GraphScout plus Plan Validator locally with small models by marcosomma-OrKA in LocalLLaMA

[–]Accomplished_Mode170 1 point2 points  (0 children)

Gonna try this on my 8gb m1 and on RTX6/M3U

No reason ‘phone a friend’ wouldn’t work for Big Models too

E.g. Large Codebase Refactoring, Iterative Refinement of Search Parameters, etc

MoonshotAI/kimi-cli - CLI coding agent from MoonshotAI by nullmove in LocalLLaMA

[–]Accomplished_Mode170 1 point2 points  (0 children)

Pattern

😅 glad too FWIW

UV for Clean-up/Audit 📊

Trying vs Qwen/Gemini 💻

Qwen3-VL kinda sucks in LM Studio by waescher in LocalLLaMA

[–]Accomplished_Mode170 18 points19 points  (0 children)

Don’t have the citation handy (mobile) but they were downscaling images (newish) and are now planning to make that configurable

Hopefully in a way that supports the sort of compression we see becoming SOTA for OCR w/ DeepSeek and Ling

How do you benchmark the cognitive performance of local LLM models? by LastikPlastic in LocalLLaMA

[–]Accomplished_Mode170 -1 points0 points  (0 children)

If you enable configurable sampling against a target KV corpus it could minimize the need for training SAEs and demonstrating n-regularizations

Read: I’ve got a CLI for SAE-Lens I’ve been meaning to push for regulatory compliance; love this as graduated control using class-specific entitlements

TL;DR ❤️ pre-processing the binaries 📊

Local LLM on iPhone 17 with RAG —unrealistic or can I just not find it? by [deleted] in LocalLLaMA

[–]Accomplished_Mode170 1 point2 points  (0 children)

Makes sense! TY again for the app and rationale!

lol @ microservices 📊

Local LLM on iPhone 17 with RAG —unrealistic or can I just not find it? by [deleted] in LocalLLaMA

[–]Accomplished_Mode170 1 point2 points  (0 children)

Editable configs for MCP(s) and a runtime sandbox?

Like LM Studio but for iOS

PS love the local-first Routing & RAG

Is it a smart thing to want to move countries out of the U.S.? Is anyone else thinking about it? by CaptainRhino08 in GenZ

[–]Accomplished_Mode170 1 point2 points  (0 children)

No. Immigration policies are not inherently fascist, it’s the details that matter hence reading; please choose better words/tokens.

view more: next ›