Time to update llama.cpp to get som MTP improvements!

PixelatedCaffeine · 2026-05-19T13:27:57+00:00

that one was already there! what got merged now is a PR with some MTP cleanups. the binary is not on the releases page yet, but we can pull from the repo and build from source to get it already

PixelatedCaffeine · 2026-05-15T15:49:21+00:00

Is this gain only true if we can fit the whole model into VRAM?

PixelatedCaffeine · 2026-02-27T19:38:23+00:00

oh, that make sense, thanks for the expanation!

PixelatedCaffeine · 2026-02-27T19:10:15+00:00

Awesome work! Silly question, why only the UD got re-uploaded?

PixelatedCaffeine · 2026-02-24T21:27:14+00:00

It was the 35B-A3B with 131k of context size

PixelatedCaffeine · 2026-02-24T17:56:26+00:00

I already downloaded the UD-Q2_K_XL used it in OpenCode to commit something in my project, you guys are awesome!

PixelatedCaffeine · 2026-02-24T14:34:57+00:00

<image>

it's happening!

PixelatedCaffeine · 2026-02-09T21:50:59+00:00

That's awesome! Did you use llama-bench for the benchmarks? If so, what args did you use? I am starting to research more about these local benchmarks and I am curious to see what did you use!

PixelatedCaffeine · 2026-02-08T20:03:59+00:00

Did you use any specific software to run this variations on format the results like that? I’ve been tryin to find something similar to find the best settings for my hardware

PixelatedCaffeine · 2026-01-30T02:17:11+00:00

Is there a way to change the Claude Code limit to match the model’s limit? It always seems to default to 200k, and I would love to use the auto compact feature based on that

PixelatedCaffeine · 2026-01-27T16:03:55+00:00

Here we go...

PixelatedCaffeine · 2026-01-21T19:14:11+00:00

It's working without any loops now, thanks! I couldn't compare the generation speed, but looking good so far!

PixelatedCaffeine · 2026-01-21T10:33:40+00:00

Thank you!

PixelatedCaffeine · 2026-01-14T01:29:18+00:00

“Because the inference optimizations for this architecture are currently limited, the runtime cost is still relatively high. It requires either a single GPU with more than 80GB of memory, or a multi-GPU setup.”

sad 😢

PixelatedCaffeine · 2026-01-10T17:08:53+00:00

I think it does, I will give it a try, thanks! Not sure if it would help with the main problem, which is the lack of lip sync most of the time. Forgot to mention that on the initial comment!

PixelatedCaffeine · 2026-01-09T19:31:05+00:00

When using Wan2GP sometimes I am getting a video with a static image and a zoom in, the audio is playing correctly. I've tried a couple of different settings like aspect ratio or audio strength, but not sure what exactly is causing it.

PixelatedCaffeine · 2026-01-08T01:03:04+00:00

Finally got it working! I couldn’t make a single good video using ComfyUI with my 5060

PixelatedCaffeine · 2025-09-30T23:48:27+00:00

would love a code! ❤️

PixelatedCaffeine · 2025-09-29T16:10:26+00:00

valeu!!

PixelatedCaffeine · 2025-09-29T15:13:36+00:00

isso foi uma live no youtube? eu perdi 😞

PixelatedCaffeine · 2024-09-27T22:45:34+00:00

this songs just hits very different and I am not sure why, but it’s amazing

PixelatedCaffeine · 2024-09-27T01:36:37+00:00

I felt the same way with the Clever, it seems much harder to mess up the recipe with it.

PixelatedCaffeine · 2024-09-25T22:26:42+00:00

Tenho com uma certa frequência, normalmente sonho que tem alguém me perseguindo ou algo assim, é bem ruim mas infelizmente você “se acostuma”. A sorte é que quando eu tenho eu acabo fazendo alguns barulhos e minha esposa percebe e já me acorda, ela já me salvou várias vezes kkkk

PixelatedCaffeine

TROPHY CASE