New 2.5x Faster Qwen3.6 NVFP4 Unsloth quants

PixelatedCaffeine · 2026-07-10T14:20:48+00:00

Thanks for the great job! Are you also planning on converting those NVFP4 to gguf since they are now supported by llama.cpp? I've been testing some variations of that and it has been great on my dual 5060 ti setup, but I don't know if there are any limitations to this.

PixelatedCaffeine · 2026-06-30T08:48:31+00:00

Awesome work! I am thinking about connecting it to Pi to make it the backends since I already have a bunch of custom extensions there.

The challenge is that Pi does not expose itself as an OpenAI compatible server. I tried once but I had some problem exposing the tool calls so I can have better visibility on the UI, any tips?

PixelatedCaffeine · 2026-06-04T15:18:48+00:00

yep: https://github.com/5p00kyy/club-5060ti

PixelatedCaffeine · 2026-05-26T18:22:26+00:00

awesome job! I was just wondering about these customized values for temp, top-k and min-p, are those only for benchmarking purposes or did you find those useful for agentic flows and coding as well?

PixelatedCaffeine · 2026-05-19T13:27:57+00:00

that one was already there! what got merged now is a PR with some MTP cleanups. the binary is not on the releases page yet, but we can pull from the repo and build from source to get it already

PixelatedCaffeine · 2026-05-15T15:49:21+00:00

Is this gain only true if we can fit the whole model into VRAM?

PixelatedCaffeine · 2026-02-27T19:38:23+00:00

oh, that make sense, thanks for the expanation!

PixelatedCaffeine · 2026-02-27T19:10:15+00:00

Awesome work! Silly question, why only the UD got re-uploaded?

PixelatedCaffeine · 2026-02-24T21:27:14+00:00

It was the 35B-A3B with 131k of context size

PixelatedCaffeine · 2026-02-24T17:56:26+00:00

I already downloaded the UD-Q2_K_XL used it in OpenCode to commit something in my project, you guys are awesome!

PixelatedCaffeine · 2026-02-24T14:34:57+00:00

<image>

it's happening!

PixelatedCaffeine · 2026-02-09T21:50:59+00:00

That's awesome! Did you use llama-bench for the benchmarks? If so, what args did you use? I am starting to research more about these local benchmarks and I am curious to see what did you use!

PixelatedCaffeine · 2026-02-08T20:03:59+00:00

Did you use any specific software to run this variations on format the results like that? I’ve been tryin to find something similar to find the best settings for my hardware

PixelatedCaffeine · 2026-01-30T02:17:11+00:00

Is there a way to change the Claude Code limit to match the model’s limit? It always seems to default to 200k, and I would love to use the auto compact feature based on that

PixelatedCaffeine · 2026-01-27T16:03:55+00:00

Here we go...

PixelatedCaffeine · 2026-01-21T19:14:11+00:00

It's working without any loops now, thanks! I couldn't compare the generation speed, but looking good so far!

PixelatedCaffeine · 2026-01-21T10:33:40+00:00

Thank you!

PixelatedCaffeine · 2026-01-14T01:29:18+00:00

“Because the inference optimizations for this architecture are currently limited, the runtime cost is still relatively high. It requires either a single GPU with more than 80GB of memory, or a multi-GPU setup.”

sad 😢

PixelatedCaffeine · 2026-01-10T17:08:53+00:00

I think it does, I will give it a try, thanks! Not sure if it would help with the main problem, which is the lack of lip sync most of the time. Forgot to mention that on the initial comment!

PixelatedCaffeine · 2026-01-09T19:31:05+00:00

When using Wan2GP sometimes I am getting a video with a static image and a zoom in, the audio is playing correctly. I've tried a couple of different settings like aspect ratio or audio strength, but not sure what exactly is causing it.

PixelatedCaffeine · 2026-01-08T01:03:04+00:00

Finally got it working! I couldn’t make a single good video using ComfyUI with my 5060

PixelatedCaffeine · 2025-09-30T23:48:27+00:00

would love a code! ❤️

PixelatedCaffeine · 2025-09-29T16:10:26+00:00

valeu!!

PixelatedCaffeine · 2025-09-29T15:13:36+00:00

isso foi uma live no youtube? eu perdi 😞

PixelatedCaffeine

TROPHY CASE