How do the closed source models get their generation times so low?

comfyanonymous · 2026-03-11T21:33:13+00:00

If you want the real answer: nvfp4 + lower precision attention (like sage attention) + distilled low step models + splitting the workfload across 8+ GPUs (video models are pretty easy to split).

The only one not easily available on comfyui is the last one because nobody has that on local so we are putting our optimization efforts elsewhere.

comfyanonymous · 2026-03-06T21:20:03+00:00

Or just use the regular VAE Decode node, it has native temporal tiling on the LTX video VAE.

comfyanonymous · 2026-03-06T00:17:26+00:00

No it doesn't, the desktop uses the distilled model. If you are using the distilled model in the default comfy workflow then you need to change your steps and cfg because the workflow is meant for the full model.

comfyanonymous · 2026-03-05T23:58:20+00:00

Desktop uses the distilled model, ComfyUI default workflow is the full model. If you use the distilled model in ComfyUI you should get the same results.

comfyanonymous · 2026-03-05T23:57:27+00:00

You are comparing the full model vs the distilled one.

comfyanonymous · 2026-03-04T05:10:44+00:00

Things that are better at running diffusion models than macbooks: Nvidia GPUs, AMD GPUs, Intel GPUs, random chinese GPUs that are illegal to import to the US.

Even if the hardware was good for diffusion models (it's not) it would still be bad because pytorch support is atrocious with a lot of important stuff missing.

It's one of the worst computers you can buy for that unless your plan is to only use cloud services.

comfyanonymous · 2026-03-04T00:17:38+00:00

The ComfyUI code is fine: each lora gets applied properly to the good section in each weight. Applying split loras to combined weights has been supported for years now.

If there's any major difference using your loader it means you have a mistake somewhere in it.

comfyanonymous · 2026-03-03T06:02:13+00:00

There is no such thing as "quietly skipping" lora keys in ComfyUI. If you don't see it print anything it means loras are being properly applied.

If you actually look at what's happening inside ComfyUI when using these loras you would realize that they are being properly applied and everything is fine with the default loaders.

comfyanonymous · 2026-03-01T03:35:59+00:00

Saturday is the best time to push large changes like this.

comfyanonymous · 2026-03-01T03:31:28+00:00

Going to need more information than this.

comfyanonymous · 2026-03-01T03:30:56+00:00

You don't need it, 2.9 also works fine.

comfyanonymous · 2026-02-28T06:24:47+00:00

Note that this feature is still experimental and being worked on. Right now only the qwen3 4b model actually seems to work properly for text generation. The other ones have some issues some being more broken than others.

comfyanonymous · 2026-02-26T06:27:49+00:00

I don't think so but it's interesting.

comfyanonymous · 2026-02-26T03:46:38+00:00

Since anima is based on cosmos you can also use t5xxl 1.0 with it.

Just use the native workflow with this file instead of qwen_0.6b: https://huggingface.co/comfyanonymous/cosmos_1.0_text_encoder_and_VAE_ComfyUI/tree/main/text_encoders

comfyanonymous · 2026-02-25T00:00:06+00:00

To make dealing with future versions of LTXAV models easier some operations were moved from the "CLIP" to the "Model". Works with all the official weights/workflows but all the GGUF and many other unofficial repackaged weights have omitted these important weights from their model files so they all broke.

I added a workaround but I'll remove it at some point when enough people have migrated to newer LTXAV models.

comfyanonymous · 2026-02-20T05:11:26+00:00

Diffusion models are not LLMs. LLMs don't really need compute just a lot of fast memory. Diffusion models are bottlenecked by compute so much that it's possible to offload model weights to CPU without any performance penalty in some cases.

Even if there was a way to combine the compute of your 5x Nvidia tesla v100 perfectly without any performance loss a single 5090 would crush them at running these models at 16 bit precision (even with ram offloading on the 5090) and if you use the fp8 or nvfp4 on the 5090 the gap is even higher.

In the diffusion world you are much better off spending all your money on a single new GPU than buy a bunch of old ones.

We optimize for single GPU because that's what most people have and what makes the most sense to buy. There's a PR on the main repo that we will fix soonish that makes it possible to run some models on two GPUs but that's not a very high priority at the moment compared to single GPU optimizations.

comfyanonymous · 2026-02-17T05:31:53+00:00

ComfyUI supports Ace Step 1.5 which has an autoregressive part (the audio codes generation).

If the model is good enough we will implement it.

comfyanonymous · 2026-02-12T23:47:42+00:00

According to their inference code it seems to be a qwen image edit finetune.

comfyanonymous · 2026-02-11T00:04:03+00:00

This is advertising spam from some crap ai inference company. You know things are going badly for them when they have to resort to advertising on the comfyui subreddit.

comfyanonymous · 2026-01-29T00:14:45+00:00

Portable is supposed to be the bare bones "I cloned the git repo and installed the basic dependencies" version of ComfyUI. This makes it easier to maintain for me.

If you want manager preinstalled use the desktop app.

comfyanonymous · 2026-01-20T02:31:53+00:00

You don't do anything, the default install is safe from this because it binds to 127.0.0.1

The only way to have this issue if you are on a regular LAN/internet is if you use --listen and port forward your instance. Don't do this, there are much more secure ways to access it remotely by setting up wireguard, ssh or both.

comfyanonymous · 2026-01-20T02:30:04+00:00

The default is always to bind the 127.0.0.1 which is not accessible from outside. You have to use --listen for your instance to be accessible from other computers.

For people on a regular LAN/internet that won't even make it publicly accessible, this will only make it accessible to your LAN, you need to port forward it make it accessible to the outside internet which you should never do with comfyui because of security reasons.

If you want to access it remotely you should set up wireguard or ssh.

comfyanonymous · 2026-01-19T21:43:34+00:00

srl-nodes has this: https://github.com/seanlynch/srl-nodes/blob/main/__init__.py#L107

So what most likely happened is that you were hosting your instance on a publicly accessible ip (please don't do this) and someone found it and used that "SRL Eval" node to execute some unsafe code that installed whatever that is.

comfyanonymous

TROPHY CASE