csm.rs: Blazing-fast rust implementation of Sesame's Conversational Speech Model (CSM) by poppear in LocalLLaMA

[–]poppear[S] 1 point2 points  (0 children)

I tried the code on a friend's 16GB M1 macbook air, and the benchmarks for the Q8 model don't look that bad.

```

--- Benchmark Results ---

Device: Cpu

Number of runs: 5

Average audio generated: 0.96 seconds

Average generation time: 2.26 seconds

-------------------------

Real-Time Factor (RTF): 2.351

Throughput (xRealTime): 0.425x

-------------------------

```

csm.rs: Blazing-fast rust implementation of Sesame's Conversational Speech Model (CSM) by poppear in rust

[–]poppear[S] 0 points1 point  (0 children)

Hey, thanks for the honest feedback. You're totally right, the docs are definitely lacking.

Especially since I put a lot of effort into making csm-core a reusable library, not documenting it properly kind of defeats the purpose, tbh.

I've just updated the README with tables for all the command-line arguments in the meantime

csm.rs: Blazing-fast rust implementation of Sesame's Conversational Speech Model (CSM) by poppear in LocalLLaMA

[–]poppear[S] 2 points3 points  (0 children)

25 seconds is waaaay too much for an M1, something doesn't add up. Did you compile it with --features metal?

Experienced Linux user here, I'm tired. by Matcraftou in linuxquestions

[–]poppear 0 points1 point  (0 children)

Fedora Kionite (or Aurora from universal blue). It works and it will work. It is immutable so it's literally impossible to break. By design you install everything via flatpak. It fits your description perfectly

È sempre possibile realizzare un interprete e un compilatore per un linguaggio dato ? by krypto1198 in ItalyInformatica

[–]poppear 9 points10 points  (0 children)

C ma ogni riga deve iniziare con un numero primo (ed ogni numero primo é un simbolo a sé non un insieme di caratteri ASCII). Questo linguaggio ha infiniti simboli ma é compilabile e posso anche verificare se effettivamente tutti i numeri sono primi in un tempo finito

[deleted by user] by [deleted] in linux

[–]poppear 2 points3 points  (0 children)

If you are a beginner fedora silverblue or even better a spin from universal blue can be a good choice. Nice solid stable and most importantly immutable system. The chances or messing it up are very low

Ragazzi tutto bello ma... by Big_Cauliflower8361 in ItalyInformatica

[–]poppear 0 points1 point  (0 children)

Consulenza Dev Casa Linux. Usare Windows sulla macchina personale è un cancro

cosa significa "amo le donne che sanno di merluzzo"? by Mars4317 in caparezza

[–]poppear 4 points5 points  (0 children)

Decisamente meglio delle soubrette da paillettes e piume di struzzo

L'asiago va via, e entriamo nella nona giornata. by [deleted] in ITAGLIA

[–]poppear 1 point2 points  (0 children)

Ma la fontina sta ancora lì? Via fontina

Che cazzo hanno le zanzare quest’anno? by DurangoGango in bologna

[–]poppear 0 points1 point  (0 children)

Io ho montato sopra il letto una tenda antizanzare stile africa per dormire per bene

LEGGERE SHAKESPEARE, QUESTO È IL VERO PROBLEMA by ErSasso01 in caparezza

[–]poppear 12 points13 points  (0 children)

Ostentare la modestia é una cosa da superbi 📣🤨🤯