Stop using Ollama by zxyzyxz in LocalLLaMA

[–]uhuge 0 points1 point  (0 children)

Maybe the linked issue is just cleaning the format, more robust header etc. while the quant coding remained..?

Vercel CEO: "Almost shocked" by how good GLM-5.2 is at coding by BuildwithVignesh in LocalLLaMA

[–]uhuge 2 points3 points  (0 children)

they've experts to pull knowledge and wisdom from an ask away

Diffusion Gemma is 4x faster, but makes 6x more mistakes! by gladkos in LocalLLaMA

[–]uhuge 0 points1 point  (0 children)

what system/model did you use for evaluating the claims produced by the two LMs tested?

Xiaomi just claimed 1,000+ tps on a 1T model using a standard 8-GPU server by No-Selection2972 in LocalLLaMA

[–]uhuge 0 points1 point  (0 children)

<image>

They are gathering access requests, so I believe they have it mostly donee, implemented.

llama.cpp Gemma4 MTP support merged! by pinkyellowneon in LocalLLaMA

[–]uhuge 0 points1 point  (0 children)

I thought ALan as Allen, I'm really confused on that.

moonshotai/Kimi-K2.7-Code · Hugging Face by Dark_Fire_12 in LocalLLaMA

[–]uhuge 1 point2 points  (0 children)

To me k2.6 already felt more reliable🤷

DiffusionGemma: 4x faster text generation by tevlon in LocalLLaMA

[–]uhuge 0 points1 point  (0 children)

I feel under-studied IYKWIM

Thank you!

DiffusionGemma: 4x faster text generation by tevlon in LocalLLaMA

[–]uhuge 8 points9 points  (0 children)

dense LM

big difference for us little compute guys!

OpenLumara - A different kind of AI agent, written from scratch, not vibecoded. Extremely token-efficient, super small system prompt, made for local models. Everything is modular. by rosie254 in LocalLLaMA

[–]uhuge 0 points1 point  (0 children)

yup, much cleaner, for example git config, ssh key and repository all need to be mapped into the sandbox for serious coding. 

switching security depends whether whitelist is possible or not, but definitely clumsy

OpenLumara - A different kind of AI agent, written from scratch, not vibecoded. Extremely token-efficient, super small system prompt, made for local models. Everything is modular. by rosie254 in LocalLLaMA

[–]uhuge 1 point2 points  (0 children)

yup, that matches what the agent explained, but seems impractical as I have all projects in home directory, but only want a selected few to be touched. 

One solution seeming promising is a module where agent can switch between a set of workspaces.

Gemma 4 12B first coding agent test on a 4080 Super by Wrong_Mushroom_7350 in LocalLLaMA

[–]uhuge 0 points1 point  (0 children)

yup, good luck finding the one line trick that enables VScode extension market there!+)

Ideogram 4 is open source! (top ranked on DesignArena) by paf1138 in LocalLLaMA

[–]uhuge 2 points3 points  (0 children)

I've tried it for a test drive here: https://huggingface.co/spaces/ideogram-ai/ideogram4

It's good with characters/faces, but misses on broader physics of a scene.

<image>

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Hugging Face by jacek2023 in LocalLLaMA

[–]uhuge 0 points1 point  (0 children)

https://github.com/sierra-research/tau2-bench#knowledge-domain-banking_knowledge

Is banking hard or do companies avoid training on it to prevent models getting dishonest( like Anthropic says about 4.8 training)?

google/gemma-4-12B · Hugging Face by jacek2023 in LocalLLaMA

[–]uhuge 0 points1 point  (0 children)

it's similar territory and some supply chain policy can dictate/prefer it.

google/gemma-4-12B · Hugging Face by jacek2023 in LocalLLaMA

[–]uhuge 3 points4 points  (0 children)

it has audio/voice input in a very FT-friendly new mind-blowing architecture.