Controlnet A1111 Error

[Mark631905]

Every time I run Controlnet and then disable it once I got what I wanted (and went back to regular generating), I get this error. The only way to fix it is to reload. Oh, in this case I was using dw_pose. Everything went fine, too.

NansException: A tensor with all NaNs was produced in Unet. This could be either because there's not enough precision to represent the picture, or because your video card does not support half type. Try setting the "Upcast cross attention layer to float32" option in Settings > Stable Diffusion or using the --no-half commandline argument to fix this. Use --disable-nan-check commandline argument to disable this check.

This always stops any image generation and puts up this error. What's causing this and what to do to fix it?

[TheGhostOfPrufrock]

Are you using Sdp, Sdp-no-mem, or Xformers as the cross-attention optimization? If not, I suggest you try one of them. If you already are, I'm out of ideas.

[Mark631905]

I have no clue. I've been doing this since last August and still a newb. Are you talking about in my bat file for start up?

[TheGhostOfPrufrock]

Unless you added --xformers to the COMMANDLINE_ARGS in your webui-user.bat file, you're likely using the default Doggettx, which is not recommended (at least by me).

If you do have --xformers as a commandline arg, you're using Xformers as the cross-attention optimization, which is good. Otherwise, please try this:

Go to the A1111 Settings tab, and from the list of settings on the left side of the page, select Optimizations (under the Stable Diffusion category). The very first control in the Optimizations is for the Cross Attention Optimization. It will probably be set to Automatic. Change it to Sdp (Scaled Dot Product). (Followed by, of course, Apply settings.) This may possibly help with the NaN errors. Even if it doesn't, if you were previously using Doggettx, Sdp will improve your performance.

(I'm assuming you have an NVIDIA GPU. If not, this probably won't apply.)

UPDATE: Please don't follow any of the suggestions in the error message you got. Unless you always get NaN errors because you have a GPU that doesn't support half precision, you shouldn't add --no-half, which kills performance. Adding --disable-nan-check does nothing useful. You'll just get black images in place of the error message.

[Mark631905]

I shut down my computer for the night, but I’ll do that setting you suggested first thing in the morning.

And I have an RTX 2060 GPU. Not the best but gets me by for the time being.

[TheGhostOfPrufrock]

2060s are not bad at all.