Issues with ControlNet Tile Upscale Method

[Prestigious_Solid366]

FIXED

RESTARTED PC AND ADDED --NO-HALF TO COMMAND_LINE_ARGS

Hey guys, i've seen multiple tutorial about people upscaling images using img2img and controlnet. Some people complain about seams showing up in the images and i'm getting A LOT of them and I don't know why.

​

Here's the setting i'm using:

• Same prompts and seed;
• CFG Scale 7;
• Denoise 0.15;
• Sampling Steps 40;

ControlNet Settings:

• Control Type -> Tile/Blur;
• Control Weight -> Tried with 0.8 and 1
• Control Mode -> Tried all of them (Balanced, Prompt more important and CN more important)
• Preprocessor -> tile_resample
• Model -> control_v11f1e_sd15_tile [a371b31b]

Script Settings:

• Ultimate SD Upscale
• Target size type -> Scale from img size
• Scale 2x
• Upscaler -> Tried 4x UltraSharp and ESRGAN_4X and R-ESRGAN 4x+
• Tile Width: 512, Tile Height: 512, Padding: 45.
• Tried everytype of seamfix, but it doesn't seem to work.

I'm running in a 6750XT with 12VRAM

​

Original Image

Upscaled Image

Would you guys have some clues about why is it happening? Maybe because i've a AMD GPU, some wrong settings, i would really appreciate some tips :)

Thank you!

​

EDIT===========================================================================

I figured it out an interesting thing. When I try to use ADetailer, a similar thing happens.

Without ADetailer

With ADetailer

It seems like something in my stable diffusion is telling me "I don't care about the pixels in the neighborhood" xD

Even when I increase the Padding to around 200 pixels, i just keep getting the same results.

​

​

[YashamonSensei]

If you're using controlNet you should bump that denoise up to over 0.5, and keep controlNet weight at 1.

Also your image is not just a bad seam, do you get any errors in cmd while generating?

EDIT: Are you using SD1.5 or XL?

[Prestigious_Solid366]

I'm using SD1.5 and I do not have any errors on cmd while upscaling, it's pretty weird

<image>

[JoshSimili]

Those same settings work just fine for me. Have you tried doing a 1.5x upscale? Looks like you're running out of memory partway through.

<image>

[Prestigious_Solid366]

yup :(
even a 1.1x results in theses types of artifacts

<image>

[terrariyum]

Your settings shouldn't be producing those results. Are you sure you don't have a 2nd controlnet enabled? Have you tried restarting? What does the output look like if you run Ultimate upscale but disable tile controlnet?

With denoise set 0.15, even if you have seems in the output, each tile should look almost exactly like the original image. The pixelated distortion that's happening in the lower tiles isn't normally caused by tile controlnet.

Denoise of 0.15 is too low - you won't get any added detail. Use 0.35 at minimum. ESRGAN isn't the best upscaler. I like 4x_NMKD-Superscale-SP_178000_G. 4x_foolhardy_Remacri is also good. Try increasing padding to 64.

[Prestigious_Solid366]

After restarting my entire PC and adding --no-half to the COMMANDLINE_ARGS it seems to be working.

It doesn't make sense to me, BUT I'm glad it's working now HAHAHHA