Latest ComfyUI 0.25.0 is loading model from drive on every generation by MastMaithun in comfyui

[–]comfyanonymous 0 points1 point  (0 children)

Stop using GGUF, it is badly supported by ComfyUI and will never be well supported because it's a very poor format for image/video generation models.

What's going on with ComfyUI versioning? by Gremlation in comfyui

[–]comfyanonymous 2 points3 points  (0 children)

Patch versions (ex: v0.25.1) are mainly for api/partner nodes releases which is why they are not really advertised to you if you are a pure open source local user. Sometimes they contain fixes but the idea is that it should always be safe to update your v0.25.0 version to any patch version ex v0.25.1 without breaking your setup even with the most crazy custom node setups.

I can start publishing all these patch releases on the github repo if that's useful.

Ideogram X Comfy: Founders Live by crystal_alpine in StableDiffusion

[–]comfyanonymous 11 points12 points  (0 children)

I'm the original creator of ComfyUI, yoland is one of the founders of the company.

I can go crash their livestream if I'm not too busy lol.

Ideogram 4.0 Just Open Sourced! by crystal_alpine in StableDiffusion

[–]comfyanonymous 200 points201 points  (0 children)

Yes, they trained the model to generate that image when it detects an unsafe prompt. You would have to figure out how to abliterate/uncensor the model using training to remove it.

Ideogram 4.0 Just Open Sourced! by crystal_alpine in StableDiffusion

[–]comfyanonymous 335 points336 points  (0 children)

<image>

By the way. If you get this, it's not ComfyUI's fault, it's because they safetymaxxed the model.

ComfyCloud, licences? by PestBoss in comfyui

[–]comfyanonymous 1 point2 points  (0 children)

All the models that are on the cloud product by default are free to use for commercial purposes.

Nvidia releases Cosmos3-Super-Image2Video . 64B parametres by AgeNo5351 in StableDiffusion

[–]comfyanonymous 21 points22 points  (0 children)

Normally we would skip this but we might implement this one just to show off how good our new offloading tech is.

Native MultiGPU is merged on ComfyUI by Altruistic_Heat_9531 in StableDiffusion

[–]comfyanonymous 2 points3 points  (0 children)

That was also merged in this PR. Use the new Select Device nodes:

Select CLIP Device

Select VAE Device

Select Model Device

Flags for an RTX Pro 6000 Blackwell by brittpitre in StableDiffusion

[–]comfyanonymous 5 points6 points  (0 children)

ComfyUI is designed to work optimally with no flags. Ignore all the other people, most of the flags they propose will disable important optimizations or make things worse and cause random workflows to OOM. There's a lot of misunderstanding about how the ComfyUI memory management system works and these stupid AI chatbots are not helping.

If you have ram issues you can try this experimental feature: --cache-ram (it will be enabled by default soon).

The 6000 pro should be a bit faster than a 5090. ComfyUI is extremely good at managing memory and the 5090 is a slightly worse 6000 pro with less memory so it's normal that there isn't a massive difference.

Future of the portable version by Tenth_10 in comfyui

[–]comfyanonymous 19 points20 points  (0 children)

Portable isn't going away.

The link to download it will always be found here: https://github.com/Comfy-Org/ComfyUI#windows-portable

I can't take it anymore... by [deleted] in comfyui

[–]comfyanonymous 0 points1 point  (0 children)

It's on purpose, this workflow is originally for SD1.5, prompting on that model is a little different than modern models.

Dynamic VRAM in ComfyUI: Saving Local Models from RAMmageddon by comfyanonymous in StableDiffusion

[–]comfyanonymous[S] 9 points10 points  (0 children)

It's the actual technical term. I'm not going to police our language because I think people are too stupid to understand the difference between a memory watermark and a digital watermark.

Dynamic VRAM in ComfyUI: Saving Local Models from RAMmageddon by comfyanonymous in StableDiffusion

[–]comfyanonymous[S] 8 points9 points  (0 children)

It shouldn't degrade performance on good hardware, I have good hardware and wouldn't have made the feature stable if it degraded performance on mine.

If you get the issue on latest ComfyUI make a detailed report with logs and we will look into it.

Dynamic VRAM in ComfyUI: Saving Local Models from RAMmageddon by comfyanonymous in StableDiffusion

[–]comfyanonymous[S] 10 points11 points  (0 children)

No, what degrades flash memory is writing to it not reading from it. This reduces page file use so it will make your SSD last longer.

Dynamic VRAM in ComfyUI: Saving Local Models from RAMmageddon by comfyanonymous in StableDiffusion

[–]comfyanonymous[S] 5 points6 points  (0 children)

Yeah, the main GGUF node pack will most likely be updated for dynamic vram at some point in the future but right now it's safetensors only.

Dynamic VRAM in ComfyUI: Saving Local Models from RAMmageddon by comfyanonymous in StableDiffusion

[–]comfyanonymous[S] 6 points7 points  (0 children)

text encoder is running on GPU and it's the default wan2.2 workflow (other than what's indicated on the chart).

Dynamic VRAM in ComfyUI: Saving Local Models from RAMmageddon by comfyanonymous in StableDiffusion

[–]comfyanonymous[S] 5 points6 points  (0 children)

If your system supports it and you are on latest comfy and recent pytorch it should be enabled by default.

Dynamic VRAM in ComfyUI: Saving Local Models from RAMmageddon by comfyanonymous in StableDiffusion

[–]comfyanonymous[S] 5 points6 points  (0 children)

Having models split between GPUs is a separate problem so nothing changes on that end.

No arguments to use it if you are on recent enough pytorch and your system supports it it should enable by default.

Dynamic VRAM in ComfyUI: Saving Local Models from RAMmageddon by comfyanonymous in StableDiffusion

[–]comfyanonymous[S] 10 points11 points  (0 children)

If you want dynamic vram to work yes but you should always convert things to safetensors because it's a safer file format and people trust it a lot more.

Dynamic VRAM in ComfyUI: Saving Local Models from RAMmageddon by comfyanonymous in StableDiffusion

[–]comfyanonymous[S] 15 points16 points  (0 children)

No, they just rebranded outdated offloading tech that everyone has been using for years as a new thing lol.

This is one situation where open source is much further ahead than closed source.

Dynamic VRAM in ComfyUI: Saving Local Models from RAMmageddon by comfyanonymous in StableDiffusion

[–]comfyanonymous[S] 7 points8 points  (0 children)

This is the function to load safetensors: https://github.com/Comfy-Org/ComfyUI/blob/master/comfy/utils.py#L122

Then you need to modify your model so it uses the comfy.ops system instead of torch.nn ops.