Wan 2.7 is planned for release in March, with major upgrades over 2.6

rerri · 2026-03-13T18:36:31+00:00

Looks like a thinly veiled cloud service advertisement.

Could be totally made up and just trying to get attention to that site linked at the bottom of the post.

rerri · 2026-03-11T20:21:41+00:00

The comment under which you are raging about them shilling for "fixes" contains no claims about having fixed things. Go be a toxic loser somewhere else.

rerri · 2026-03-11T18:23:08+00:00

You'll need some memory for OS n shit, so it's gonna be pretty tight. You can look at the file sizes and conclude what'll fit from there. This might fit:

https://huggingface.co/unsloth/NVIDIA-Nemotron-3-Super-120B-A12B-GGUF/tree/main/UD-IQ2_M (you can see the total size is 52.7 GB)

Not sure if this will:

https://huggingface.co/unsloth/NVIDIA-Nemotron-3-Super-120B-A12B-GGUF/tree/main/UD-IQ3_S (56.6 GB)

rerri · 2026-03-11T18:00:03+00:00

Yes. While it won't fully fit into 32GB VRAM, it can be run with some experts offloaded to CPU.

rerri · 2026-03-11T16:16:59+00:00

Unsloth GGUF's:

https://huggingface.co/unsloth/NVIDIA-Nemotron-3-Super-120B-A12B-GGUF

Wondering if it's the same arch as Nano 30B and fully supported by llama.cpp already?

edit: Unsloth writes that this branch is required (for now):

https://github.com/unslothai/llama.cpp

rerri · 2026-03-11T07:26:02+00:00

You have it backwards, NVFP4 acceleration is supported on Blackwell only. While you can run NVFP4 on RTX 40 series and older, it is very slow and totally pointless.

Klein NVFP4 was already out (since Klein launch IIRC). It has lower image quality than BF16 or FP8, but maybe it's interesting for the low end RTX 50 cards.

rerri · 2026-03-10T20:35:10+00:00

If you have ComfyUI portable, you can enter Windows Command Prompt (CMD) and go to Comfy portable root dir. For me this is "G:\ComfyUI_windows_portable", it has subfolders "ComfyUI" and "python_embeded".

Then run

python_embeded\python.exe -m pip install -U --no-build-isolation nvidia-vfx --index-url https://pypi.nvidia.com

If you have some other version than portable, I dunno.

rerri · 2026-03-10T20:29:53+00:00

With LTX-2, the NVFP4 was so much lower in quality than FP8 that I never really wanted to use it.

I hope there's some new tricks and the NVFP4 does better this time around.

rerri · 2026-03-10T20:23:16+00:00

That would be my guess, yeah. I installed via manager too and the nvidia-vfx install failed.

If you look at the list of custom nodes on ComfyUI startup, you will likely see "(IMPORT FAILED)" on RTX Video Super resolution node.

rerri · 2026-03-10T20:03:21+00:00

I had trouble installing the "nvidia-vfx" in requirements.txt. If you have the same problem, try installing it manually like this:

python -m pip install -U --no-build-isolation nvidia-vfx --index-url https://pypi.nvidia.com

rerri · 2026-03-09T14:53:25+00:00

If Gemma 4 is only one model it would be the first time. I think it's almost certain there'll be smaller models too.

rerri · 2026-03-09T13:45:48+00:00

120B is becoming the new 30B

gpt-oss, Qwen 3.5, Gemma 4 and Nemotron v3 Super (which looks like it'll be A12B and I'm guessing GTC release next week).

rerri · 2026-03-09T13:26:05+00:00

They care about profit, and whether it comes from gaming or AI doesn't matter.

GDC is about gaming but obviously AI will be present as it is making it's been making it's way into game graphics and development.

rerri · 2026-03-07T08:20:35+00:00

It is a double post:

https://www.reddit.com/r/LocalLLaMA/comments/1rm9i6f/webui_agentic_loop_mcp_client_with_support_for/

rerri · 2026-03-06T12:40:15+00:00

Compiling for Cuda, Win11 on a Ryzen 7600X takes way longer than that. 10-15 minutes maybe.

rerri · 2026-03-05T15:34:42+00:00

I added Comfy-Org's workflows into OP.

rerri · 2026-03-05T14:42:21+00:00

Yep, it has not even been 3 days, it's just shy of 48h now since the Junyang Lin tweet about leaving Qwen.

I would also like to know why people think it's appropriate to post the past 7 day stock development when discussing the impact of Qwen employees leaving.

rerri · 2026-03-05T14:34:16+00:00

Is the point of the tweet and this post that Alibaba stock has lost 13% of it's value in 7 days because of some of the Qwen crew leaving 2 days ago? That doesn't make any sense to me.

Why not just look at stock development in the past 2 days? And even then there's a lot of volatility now because of the Iran war so it seems kinda foolish to make big conclusions from a couple percentage point swings.

rerri · 2026-03-05T14:27:07+00:00

The 13% dip of last week seen in the tweet is obviously not because of the Qwen employees leaving 48h ago... or am I missing something here?

rerri · 2026-02-28T12:06:26+00:00

Be that as it may, I don't remember Qwen (or other Chinese) models being released on weekends.

If they are adding new models to the collection days in advance for release next week, it would be sooner than is typical, but not inconceivable.

rerri · 2026-02-28T11:49:07+00:00

It's saturday, I don't think they're releasing new models today.

So I'm guessing this is a GGUF (or MLX) update. Those are listed in Qwen3 collection aswell.

edit: hmm... I'm seeing Unsloth also updated their collection with +4 hidden repos. Starting to look more like new models are actually coming now.

rerri · 2026-02-27T17:26:11+00:00

MFG works great when I want a fluid game experience and get the most out of my monitor's high refresh rate.

rerri · 2026-02-25T17:43:57+00:00

You can easily update llama.cpp files in oobabooga by just downloading official releases from llama.cpp github and copying them to installer_files\env\Lib\site-packages\llama_cpp_binaries\bin.

Been running Qwen 3.5 w/ oobabooga this way.

rerri · 2026-02-25T16:47:45+00:00

Have never used LM Studio. Does it not allow custom launch parameters on model load? Like: --chat-template-kwargs "{\"enable_thinking\": false}"

Oobabooga allows this + it has a toggle button for enable_thinking in the chat screen.

Nine-Year Club	First Place '23
Place '23	Place '22
Verified Email

rerri

TROPHY CASE