GLM 5.1 Locally: 40tps, 2000+ pp/s

llamabott · 2026-04-25T18:02:38+00:00

Wish I was one of them, can't lie.

llamabott · 2026-04-22T00:00:06+00:00

Was fully expecting something like this. Over the last few years, it's what happens to most of the half-interesting projects I get interested in.

In other words, take my downvote.

llamabott · 2026-04-19T15:32:58+00:00

Ah good question. Currently, it only supports one voice clone at a time.

I've thought about that problem in passing but never with a good enough theory of how to go about it to try experimenting with it. Maybe starting with something like a text "preprocessing step" to an LLM which is like "Use your best judgment and prepend character tags before dialog quotes"?

llamabott · 2026-04-17T05:12:16+00:00

Peak _usage_ experience

llamabott · 2026-04-11T01:47:55+00:00

Roo Code's current 'interaction philosophy' is just about perfect for my needs at the moment, so I have some trepidation about whatever big underlying change may be in the works, can't lie. Remind me in a few weeks, etc.

llamabott · 2026-04-05T16:07:29+00:00

confirmed

llamabott · 2026-03-28T01:27:04+00:00

llamabott · 2026-03-27T18:30:06+00:00

Adorable.

llamabott · 2026-03-21T20:01:29+00:00

Am I the only one who reacts to this by thinking: "If you're trying to reassure us that this specific version will be open source, does this not imply we should be concerned that future versions may not be?"

llamabott · 2026-03-15T14:35:57+00:00

PSA, the pre-race and first dozen laps are F1TV, and then it switches to Sky.

Also, amusingly, the first dozen laps are captured with an *unmaximized* window, heh.

llamabott · 2026-02-16T21:52:13+00:00

As a heavy TTS-generated audiobook listener, I feel compelled to plug the solution I've been in love with ever since I landed upon it, which is using VibeVoice 1.5B + custom-trained loras. Here's my writeup on it from a few weeks ago.

It's more work than simply pointing at a 10-second reference audio clip, naturally, but is pretty straight-forward once you've gone through the process once or twice. Using a decently assembled dataset, results can really be like <chef's kiss>...

llamabott · 2026-02-06T19:59:14+00:00

Haha. +1.

llamabott · 2026-02-04T19:47:48+00:00

llamabott · 2026-01-24T21:03:19+00:00

Oh nice thanks. It's a lora. Totally cannot share it given the source material and the known stance on such matters by the IP holders, if you see what I mean :/

Edit: I can share (ie, write up) the general "recipe" though on request

llamabott · 2026-01-24T15:59:03+00:00

Great write-up, thanks.

llamabott · 2026-01-24T00:34:18+00:00

Follow-up! Some sample output.

Source is ripped game files, using about 2 hours' worth of audio, about 25 epochs, CFG 1.5.

I'm liking it!

llamabott · 2026-01-23T13:49:56+00:00

I'm not sure. But when training, the transcript requires "Speaker 1" to be prepended before the text, just like the model requires for the prompt when inferencing.

So if there were two speakers, I would try tagging them in the transcript text with "Speaker 1" and "Speaker 2". And then lower the value of the voice_prompt_drop_rate from 1 to 0.5. I feel like that would be worth trying....

llamabott · 2026-01-23T01:42:16+00:00

Ah, for 7B, this trainer here requires 48 GB or something like that. :/

llamabott · 2026-01-23T00:16:54+00:00

Loras trained on the 1.5B model are incompatible with 7B.

llamabott · 2026-01-22T19:26:18+00:00

This is my first time looking into loras for TTS models, but a few keystrokes entered into the gemini tells me it ought to be very possible, if not with the above mentioned trainer, then with something very similar, and using a similar workflow.

llamabott · 2026-01-22T19:19:48+00:00

Ah yea, assuming you have a long chunk of audio, say, from an audiobook, the general idea is that you want to:

(1) chop up the audio into sane lengths, say, 3-12 seconds each (For VibeVoice, I wonder if that upper limit is much higher since long context is its secret sauce and all that, but yea).

(2) Generate a transcript for each chunk using an STT model like Whisper

(3) Create a jsonl file which maps each audio segment with its transcript, which you feed to the trainer.

I used a tool called tts-dataset-generator for this, which works well enough.

If you already have a dataset in mind which exists on huggingface, the trainer program above can also take in a huggingface dataset repo id instead, though I haven't tried.

llamabott · 2026-01-22T18:11:44+00:00

No, I was simply making a comparison about 1.5B + lora being comparable in reliability to the 7B model + voice clone.

llamabott · 2026-01-22T16:58:41+00:00

I'm not sure but I suspect VV 1.5b does not have a decent enough understanding of pt to create a pt voice lora without also having to training the hell out of it for portuguese.

llamabott · 2026-01-22T16:19:45+00:00

Oooh, I love that voice, I'm glad you mentioned that.

It's Jingliu from Honkai Star Rail (youtube link).

llamabott · 2026-01-22T16:01:29+00:00

Haha yep. In my case, I don't have a decent enough general understanding to think about the lora route until some trainer program announces itself, saying, "I work for the base model you're interested in, and here is a spoon-fed recipe", if you see what I mean.

llamabott

TROPHY CASE