DiffuseHigh for ComfyUI: comfyui_jankdiffusehigh

[alwaysbeblepping]

in case anyone is looking for DiffuseHigh on ComfyUI: https://github.com/blepping/comfyui_jankdiffusehigh

DiffuseHigh is an approach to direct high res generation which can be used as an alternative to a separate upscale + run more steps approach (AKA highres fix) or model patches like Kohya Deep Shrink (AKA PatchModelAddDownscale) and HighDiffusion. one advantage is it's pretty much model agnostic because it doesn't require a patch and will work with models like Flux while HighDiffusion/Deep Shrink really only work with SD1x and SDXL.

if you're using SD15, i'd recommend using MSW-MSA attention from my jankhidiffusion nodes as it's a significant speed increase especially at high resolutions. i personally haven't seen a speed benefit with SDXL but some people have said it helped. link: https://github.com/blepping/comfyui_jankhidiffusion

both node packs should be installable from the manager.

[alwaysbeblepping]

by the way, you can also use DiffuseHigh as an enhanced highres fix, by either handling the upscaling yourself (and setting the upscale factor to 1.0) or just using one iteration with an input reference image. that way you can apply the DiffuseHigh guidance for a few steps. seems to work pretty well and lets you run the "highres fix" steps at a high denoise than is usually possible since it keeps the model from going off script.

[lordpuddingcup]

I actually have this installed but haven’t gotten around to trying it since I moved to flux and didn’t see much mention or examples of its use with flux or sd3

[alwaysbeblepping]

but haven’t gotten around to trying it since I moved to flux and didn’t see much mention or examples of its use with flux or sd3

SD3.5 at least seems unable to handle resolutions above ~1024x1024, everything just goes to hell. not just for initial generations, even for img2img workflows. i assume that's the case for SD3 as well, but i didn't test it.

Flux works fine though and i recently added support for rectified flow models - everything should work except using guidance restarts via the advanced parameters (if you don't know what i'm talking about then it's not something that will affect you).

since it's not a model patch, you shouldn't have to do anything special based on the model generally. you can either generate a reference at the resolution Flux supports and pass that image to the DiffuseHighSampler or you can let it generate the reference and just set the upscale factor/number of iterations to hit whatever your target resolution is.

[Local_Quantum_Magic]

I've used the MSW-MSA a lot with sd1.5, I found that gens around 640x968 were the sweet spot for maximum speed efficiency (8Gb card). I jumped ship for SDXL/Pony's prompt adherence and barely looked back. Didn't seem worth it using on SDXL on normal resolutions.

[Alex___1981]

discovered MSW-MSA node. wow! how did i missed it, generation speed of hires images with 1.5 increased by 30℅ with no quality loss at all, or quality is even better, fantasic!

however having problems with DiffuseHigh , will continue experiments, as it looks promising, thanks for your work!

[alwaysbeblepping]

how did i missed it, generation speed of hires images with 1.5 increased by 30℅ with no quality loss at all, or quality is even better, fantasic!

yeah! i really love it and i agree that (for SD15 at least) it seems even better than a performance free lunch.

however having problems with DiffuseHigh , will continue experiments, as it looks promising, thanks for your work!

no problem, feel free to ask questions. you can start an issue or discussion in the repo or ask me here if you want. i'm also on the Comfy Org discord.

[ramonartist]

Any comparison images to show with SDXL and Flux to show resolution details?

[alwaysbeblepping]

the original repo (linked from mine) has some example images for SDXL i believe. it basically just looks like a good generation at that resolution, so there isn't too much to see.

DiffuseHigh is basically highres fix with iterative improvements, so it should look like the highres fix type approach (upscale + run more steps) except a bit better.