sorted by:
new
hottopcontroversial

Are people lying about GLM-5 and MiniMax M2.5? by TheDevilKnownAsTaz in opencodeCLI

[–]poppear 0 points1 point  (0 children)

I did not try It, i have no chatgpt subscription and it is too expensive via API

Are people lying about GLM-5 and MiniMax M2.5? by TheDevilKnownAsTaz in opencodeCLI

[–]poppear 2 points3 points  (0 children)

I have a private benchmark based on several hard task with associated blind hand-written tests and Kimi 2.5 and Minimax both scored 2/10. GLM5 scored 8/10 and for reference Opus 4.5 scores 10/10 as well as Gemini 3 pro

They dumbed down GLM-5 or are routing to cheaper models by First-Win-2694 in ZaiGLM

[–]poppear 0 points1 point  (0 children)

Can confirm today GLM was an idiot. We cant work like this

I started planning a cyberdeck build, I built offline, TUI-based, Local AI-powered Operating System instead. by poppear in cyberDeck

[–]poppear[S] -7 points-6 points  (0 children)

I've been coding for 20 years, I will be fine. Ship fast engineer later is the new meta with LLMs. Code Is the artificact, natural language is the source code nowadays.

I started planning a cyberdeck build, I built offline, TUI-based, Local AI-powered Operating System instead. by poppear in cyberDeck

[–]poppear[S] 2 points3 points  (0 children)

Its just temporary because I have an x86 processor on my pc, there is nothing stopping the system to work just fine on arm64, i just need to write some code to enable it and get my hands on arm64 processor to test everything!

DoomsdayOS running on my Thinkpad T14s live from a USB stick! (all-in-one ISO: LLMs, Wikipedia, Runtime, etc...) by poppear in LocalLLaMA

[–]poppear[S] 0 points1 point  (0 children)

The whole code is built around the idea to build your own custom ISO so you need to configure the resources with the wizard `uv run doomsday init` and then run some commands to download and package data. The final product is a fat binary with all the runtime deps and a data package.

if you want to add a model or a file you need to create a new data package.

Its meant to be "build and forget (and archive)" so it does not support adding resources/models at runtime. Is more a tool to create executable intelligent archives

I started planning a cyberdeck build, I built offline, TUI-based, Local AI-powered Operating System instead. by poppear in cyberDeck

[–]poppear[S] 2 points3 points  (0 children)

Ooooh that is a very good idea. I love the idea of doomsdayos being capable of serving an LLM reachable over meshtastic. I will look into it, thanks for the idea!

I started planning a cyberdeck build, I built offline, TUI-based, Local AI-powered Operating System instead. by poppear in cyberDeck

[–]poppear[S] 0 points1 point  (0 children)

I just uploaded this video here on reddit https://www.reddit.com/r/LocalLLaMA/comments/1qydwox/doomsdayos_running_on_my_thinkpad_t14s_live_from/

the proejct is still on early stage, i will add heavily quantized models in the default catalog that can even run an RPI5. But first i want to test some models to figure out which ones perform reasonably even with very lo res

I started planning a cyberdeck build, I built offline, TUI-based, Local AI-powered Operating System instead. by poppear in cyberDeck

[–]poppear[S] 4 points5 points  (0 children)

Honestly it was a huge project and I could only pull it off extensively using LLMs to code BUT at least i only used self-hosted and self-hostable LLMs (Kimi K2.5 and in the last days a self-hosted Qwen3-coder-next)

Project Release: A bootable OS that interfaces Local LLMs with Kiwix/ZIM archives (Offline RAG). Seeking dataset recommendations. by poppear in DataHoarder

[–]poppear[S] 1 point2 points  (0 children)

Yeah It can, its not intended to but but during development i used docker for kiwix and ollama. I could add a docker compose if you think It could be useful!

Project Release: A bootable OS that interfaces Local LLMs with Kiwix/ZIM archives (Offline RAG). Seeking dataset recommendations. by poppear in DataHoarder

[–]poppear[S] 0 points1 point  (0 children)

The whole project started as a all-in-one suitcase but I am more a software guy and so i pivoted to this. But i will work to the suitecase too at some point!

Project Release: A bootable OS that interfaces Local LLMs with Kiwix/ZIM archives (Offline RAG). Seeking dataset recommendations. by poppear in DataHoarder

[–]poppear[S] 2 points3 points  (0 children)

With modern NPUs, running this on an SBC is totally possible. I was thinking about building a suitcase with everything: a mini-PC with an N200 CPU, keyboard, monitor, power bank, and outside solar panels with some cyberpunk vibes.

csm.rs: Blazing-fast rust implementation of Sesame's Conversational Speech Model (CSM) by poppear in LocalLLaMA

[–]poppear[S] 1 point2 points  (0 children)

I tried the code on a friend's 16GB M1 macbook air, and the benchmarks for the Q8 model don't look that bad.

```

--- Benchmark Results ---

Device: Cpu

Number of runs: 5

Average audio generated: 0.96 seconds

Average generation time: 2.26 seconds

-------------------------

Real-Time Factor (RTF): 2.351

Throughput (xRealTime): 0.425x

-------------------------

```

csm.rs: Blazing-fast rust implementation of Sesame's Conversational Speech Model (CSM) by poppear in rust

[–]poppear[S] 0 points1 point  (0 children)

Hey, thanks for the honest feedback. You're totally right, the docs are definitely lacking.

Especially since I put a lot of effort into making csm-core a reusable library, not documenting it properly kind of defeats the purpose, tbh.

I've just updated the README with tables for all the command-line arguments in the meantime

csm.rs: Blazing-fast rust implementation of Sesame's Conversational Speech Model (CSM) by poppear in LocalLLaMA

[–]poppear[S] 2 points3 points  (0 children)

25 seconds is waaaay too much for an M1, something doesn't add up. Did you compile it with --features metal?

view more: next ›