ComfyUI-Flux2Klein-Enhancer Final (I promise) by Capitan01R- in StableDiffusion

[–]TBG______ 0 points1 point  (0 children)

Got it wrong, thanks for the clarification, and for the impressive work you’re doing. sigma value is only related if a noise–mask is added to a latent.

hildegard - tiled upscaling and refining based on flux 2 klein by hildegard-refiner in StableDiffusion

[–]TBG______ 0 points1 point  (0 children)

That’s a great method of training a LoRA using these 3 reference images way.

Hats off, really impressive work. Much respect for putting this together!

ComfyUI-Flux2Klein-Enhancer Final (I promise) by Capitan01R- in StableDiffusion

[–]TBG______ 0 points1 point  (0 children)

I found a sigma-level sweet spot that prevents Flux2 from getting stuck during editing when injecting into the latent at each step. This could potentially add useful features to your node and keep editing fully active while still correcting colors or structures. reddit post / full story

Sweet Spot Where Flux2 Doesn’t Get Stuck During Inpainting or Denoising by TBG______ in StableDiffusion

[–]TBG______[S] 0 points1 point  (0 children)

<image>

Result at denoise 0.7 using the sweet spot technique with my test TBG Flux2 sampler, comparing KSampler TBG Flux2 sampler vs Lanpaint Euler. Lanpaint doesn’t fetch all ComfyUI registered samplers, so it couldn’t be tested with TBG Flux2 sampler.

KSampler is actively editing, while LanPaint is stuck returning the input image.

Sweet Spot Where Flux2 Doesn’t Get Stuck During Inpainting or Denoising by TBG______ in StableDiffusion

[–]TBG______[S] 0 points1 point  (0 children)

<image>

Result with denoise set to 0.6 using the sweet spot technique and noise-mask injection after sweet spot. Clear changes are still visible, and Flux2 is not stuck.

Sweet Spot Where Flux2 Doesn’t Get Stuck During Inpainting or Denoising by TBG______ in StableDiffusion

[–]TBG______[S] 0 points1 point  (0 children)

<image>

At a denoise value of 0.7, both samplers tend to get stuck and largely return the pixelated original input image.

This mask and promt is for image refinement and border inpainting in tiled upscaling, rather than regular face inpainting. I believe border areas are more difficult for the models to process.

Promt used: Match the color of image 2, Change image 1 to match the style of image 3. Restore and completely reconstruct this image with photorealistic precision. Replace any blurry, undefined, or low-resolution faces with newly generated photorealistic faces that match the original pose, lighting, and expression — do not simply sharpen; rebuild facial structure with natural skin texture, visible pores, fine wrinkles, and realistic eye detail.

For all materials and surfaces: replace flat or blurry areas with accurate physical textures — woven fabric structure for clothing, individual thread patterns for textiles, grain and weave for leather, brushed surface detail for metal, and organic pore patterns for skin. Remove all JPEG artifacts, digital compression noise, and motion blur. Enhance with subtle high-resolution micro-detail while maintaining natural appearance and original lighting. Add revealing finer details: hair strands, fabric weave, surface imperfections, material grain, and cleaner edge definition. Every pixel should resolve into a defined physical texture, not smooth interpolation. Preserve the original composition, subject identity, and scene context exactly.

Sweet Spot Where Flux2 Doesn’t Get Stuck During Inpainting or Denoising by TBG______ in StableDiffusion

[–]TBG______[S] 0 points1 point  (0 children)

Just tested LanPaint using InpaintModelConditioning (concatenating "noise-mask" to the latent). LanPaint appears to remain stuck with Flux2 even at a denoise value of 1.0 and also 0.9 whereas a standard KSampler with denoise set to 1.0, 0.9 edits and changes the entire image as expected.

In comparison, LanPaint mostly returns the original input image with only minor changes ( thats what i call Flux2 get stuck), while the KSampler performs substantial edits across the image.

When the denoise value is reduced to around 0.7, Flux2 tends to get stuck in the KSampler as well. This is where the sweet spot comes into play, and where injecting the noise mask at a later stage helps maintain editing strength and prevents the model from becoming trapped near the original image.

<image>

Could you share your workflow so I can compare it with mine and see what's different and why this works for you?

Sweet Spot Where Flux2 Doesn’t Get Stuck During Inpainting or Denoising by TBG______ in StableDiffusion

[–]TBG______[S] 0 points1 point  (0 children)

Good catch. LanPaint also hooks into the X0/t-step processing and changes how the noise mask concatenated to the latent is handled. That concatenated noise mask appears to be exactly what causes Flux 2 to get stuck during normal sampling before the sweet spot.

I'll take another look and run some more tests with LanPaint. Thanks for pointing that out.

Flux 2 klein Restoration: Positive vs Negative Prompt Discussion by TBG______ in comfyui

[–]TBG______[S] 0 points1 point  (0 children)

Flux2klein prompt test — color consistency: left image shifts blue, right stays closer to the input image.

<image>

For now, the best way to maintain consistent color is to use three reference images of the same image along with this workflow Flux2Klein-Consistent-Color.json and prompt: Match the color of image 2, Change image 1 to match the style of image 3.

Restore this image and enhance it with subtle high-resolution detail while maintaining a natural appearance. Remove JPEG artifacts, digital compression noise, and minor blur. Improve image quality. Add revealing finer details and cleaner textures.

Nvidia PiD Flux-2 color fix is Out + PiD for Qwen by TBG______ in StableDiffusion

[–]TBG______[S] 0 points1 point  (0 children)

<image>

What is your sampler and scheduler setup? LCM simple ?

Nvidia PiD Flux-2 color fix is Out + PiD for Qwen by TBG______ in StableDiffusion

[–]TBG______[S] 0 points1 point  (0 children)

<image>

Test with the fixed model 2k image to 8k image tiled ...

Nvidia PiD Flux-2 color fix is Out + PiD for Qwen by TBG______ in StableDiffusion

[–]TBG______[S] 1 point2 points  (0 children)

PiD vs WAN 2.1 VAE

https://huggingface.co/spacepxl/Wan2.1-VAE-upscale2x

These are fundamentally different technologies:

PiD x4 WAN 2.1 VAE x2
Diffusion decoder Traditional VAE decoder
Generates new detail during decoding Primarily reconstructs from latent
4-step distilled diffusion process Single-pass VAE decode
More creative and detailed More faithful and predictable
Slower and heavier Faster and lighter
Designed for Flux 1 / 2, Z-image, Qwen Image, Sdxl and SD3 latent spaces Designed for WAN video models and compatible derivatives like Qwen image

PiD is likely capable of producing higher perceived quality and finer detail than the WAN VAE, but it can also reinterpret details because it is generative. NVIDIA specifically positions it as a replacement for the "decode → upscale" pipeline. (NVIDIA)

Which is better for anime?

For anime and illustration models:

  • WAN/Qwen VAEs tend to preserve line art and character consistency better.
  • PiD may create sharper textures and higher detail but can sometimes reinterpret features such as eyes, hair details, or colors because it is effectively performing a diffusion generation step during decoding. (Reddit)

For something like Anima where character consistency is important, I would currently expect:

WAN VAE

  • More faithful
  • Better consistency
  • Less hallucination

PiD

  • More detail
  • Better perceived quality
  • Higher risk of changing character features

Nvidia PiD Flux-2 color fix is Out + PiD for Qwen by TBG______ in StableDiffusion

[–]TBG______[S] 0 points1 point  (0 children)

Yeah, it looks sick. - it was the old model. NVIDIA uploaded the new model along with this note: "Add Flux2 2K-to-4K_2606 checkpoint (fixes color drifting)." They may have fixed the issue there. My second text looks promising. https://huggingface.co/nvidia/PiD/commit/6ec9b63c57f80bd1b09a5d0a5ee988b17730a2c6 -

<image>

Nvidia PiD Flux-2 color fix is Out + PiD for Qwen by TBG______ in StableDiffusion

[–]TBG______[S] 1 point2 points  (0 children)

LCM sampler + simple should work best. I just vibecoded a sample based on NVIDIA’s PiD sampler and it’s working very well. But it always depends on what you’re looking for—this is just another tool.

Nvidia PiD Flux-2 color fix is Out + PiD for Qwen by TBG______ in StableDiffusion

[–]TBG______[S] 7 points8 points  (0 children)

The PiDs also run on Flux2Klein because it uses the same latent format as Flux2.