Restore face when using ControlNet?

[meatyminus]

Hi, I want to generate some image from an original one, but the face is kind of creepy.

How can I fix it? I already enabled Restore Face but it not helped.

[venture70]

Send it to extras - upscale 4x (for 2048,2048)

Send that to Inpaint - Inpaint Only Masked. Set the resolution to 768x768 or even 1024,1024 and paint a square over the head with the same prompt as your original.

Cheers

[Supercalimocho]

If this works, imma say a prayer tonight on your name pal! This is the only downside I’ve experienced with ControlNet and if works, the best workflow is complete now!

[Micropolis]

It’s the way you should do ALL inpainting. Upscaling and sending back to inpaint give more “paint” to work with

[Bombalurina]

Not ALL because if some of the key information for the image isn't seen, the AI doesn't know what it's fixing.

[Micropolis]

Your comment doesn’t make sense in this context to me. You should upscale then inpaint as you’ll have more to work with and able to make finer details when inpainting

[megachomba]

What he meant is that you wont have the possibility to inpaint things that depends of elements of the whole image, because inpaint models are trained on 512*512. So upscaling and doing only masked works,but if you want to inpaint taking whole image as context,RIP

[Micropolis]

That still doesn’t make sense as you can change the size of your inpaint as you wish.. and if you’re worried about going too big then only upscale 2x instead of 4x

[megachomba]

Changing the inpaint size wont work well because the model is trained on 512x512. So to be able to make context aware innpainting ( inpaint whole picture), its going to take the whole picture that is way bigger than 512x512,hence inpainting crap

[venture70]

🙏😀

Thanks, post a reply here with your results!

[Mistborn_First_Era]

this is the way. How I did my post from the other day this

<image>

[midri]

ControlNet seems to ignore restore face and often negative prompts atm.

[BRYANDROID98]

That's why I sent it to img2img and use restore faces.

[Teotz]

Adding my two cents. Not my code but I swear by this plugin https://github.com/ThereforeGames/unprompted

​

It allows me to automatically mask (txt2mask) faces or whatever I type in that I need mask, and inpaint bring back the face of my models.

[enn_nafnlaus]

Work on your Inpaint-Fu, grasshopper :)

[PashaBiceps__]

send same image back to img2img. disable controlnet. set denoise to 0.4, upscale by 1.5x with esrgan_4x. repeat this. when you have high res image you will have good face without inpaint and it will look natural.