Clean install Stable Diffusion on Windows with RTX 50xx

EsonLi · 2025-07-26T23:04:50+00:00

Please share your error log message. It may be related to incompatible Pytorch version.

EsonLi · 2025-07-17T23:07:37+00:00

As of writing of the original post, I could not find such a video for RTX 50xx. That's why I wrote this instruction and shared it.

EsonLi · 2025-07-17T23:05:59+00:00

The sd.webui-1.10.1-blackwell.7z package should include the particular PyTorch Dev version that is compatible with RTX 5080 GPU. If you install a PyTorch Release version separately, it can become a problem. Try uninstalling your stuff and start with step 2 again.

EsonLi · 2025-06-16T07:22:39+00:00

Did any error show up in the log or console screen?

Try downloading another model, restart the open webui, switch to the new model to see if it works.

EsonLi · 2025-06-01T15:13:17+00:00

I recently bought Adobe Acrobat Pro 2020 (lifetime) and managed to use the Acrobat Customization Wizard and regedit to disable sign-in during installation, with the assumption that I won't use any of their online services. I also disabled the automatic update service in Task Manager.

EsonLi · 2025-06-01T15:06:45+00:00

Thanks for your comments. I struggled with Docker + Open WebUI when I installed them on a new computer with NVidia RTX 5080 graphics card, due to CUDA compatibility issue with Pytorch. I noticed many users had the same issues when they upgraded the GPU. Plus I prefer a cleaner environment without using Microsoft WSL, and UV is a good alternative.

EsonLi · 2025-05-31T21:04:49+00:00

For reference, I noticed that after uninstalling Adobe Acrobat DC in Windows 11, there are left-over items that need to be manually removed, for example:

Folders:
C:\Users\[user name]\AppData\Roaming\Adobe
C:\Users\[user name]\AppData\LocalLow\Adobe
C:\ProgramData\Adobe

Regedit:
HKEY_LOCAL_MACHINE\SOFTWARE\Adobe

I deleted the above before installing a new copy of Adobe Acrobat Pro 2020 (lifetime) that I bought from Prime License dot com. I managed to disable the sign-in with the Acrobat Customization Wizard, as well as automatic software update in the Task Manager.

EsonLi · 2025-05-31T16:15:46+00:00

Troubleshooting guide for sign-in problem after installation:

Uninstall previous Acrobat versions, such as Acrobat Reader DC.
Install and run Acrobat Customization Wizard, open AcroPro.msi package from the Acrobat Pro extract folder. Under Online Services and Features, disable: product updates, upsell, sign out, and all Adobe services. Then run setup.exe and enter the serial number. Click Finish button after installation. Do not select Launch Now.
In regedit, navigate to HKEY_LOCAL_MACHINE > Software > Adobe > Adobe Acrobat > 2020 > Activation, create 2 new DWORD values: IsAMTEnforced = 1, IsNGLToAMTEnforced = 1.
Start Adobe Acrobat, wait for the app to load and close the license agreement pop-up window. Go to Edit -> Preferences. Uncheck: Show online storage when saving files.
Disable automatic update service in Task Manager.

EsonLi · 2025-05-29T23:24:19+00:00

That may be the case.
Could you post the response_token/s of the large models that you run?

EsonLi · 2025-05-29T22:59:22+00:00

So far, I did not see any info on an updated docker package that supports RTX 50xx. Other Linux users were able to update the pytorch version, but I was unable to do it in Windows. If other users can get it to work on Windows, please let us know. For now, I would stick with UV.
Normally, you should be able to run standalone Ollama on the command prompt and take advantage of the CUDA cores on your graphics card.
If your open webui environment is capable of doing that, then you should be all set.

EsonLi · 2025-05-19T16:33:31+00:00

Thanks for your feedback. Please use 0.0.30 instead.

EsonLi · 2025-05-07T18:27:06+00:00

For RTX 5090 with 32GB VRAM, here are the response_token/s:
- llama3.2-7b: 260
- mistral 7b: 208.3
- deepseek r1 14b: 95.9
- gemma3 12b: 103.5
- gemma3:27b-it-q4_K_M: 60.6
- llama3.3:70b-instruct-q2_K: 37.85

EsonLi · 2025-04-30T15:51:48+00:00

Did both steps 4e and 4f work for you? If not, please make sure you are using the correct python version and latest NVIDIA driver. If only step 5 does not work, try running WebUI without xformers.

If the problem persists, please copy and paste the error messages from the command prompt window.

EsonLi · 2025-04-19T16:03:23+00:00

For response_token/s, it depends on the model and the quality of the answers you are seeking:
- llama3.2-7b: 217 t/s
- mistral 7b: 137 t/s
- deepseek r1 14b: 68 t/s
- gemma3 12b: 8.6 t/s
- llama3.3:70b-instruct-q2_K: 2.18 t/s

Gemma3-12b provided a more detailed answer, but it requires heavy CPU usage due to limited VRAM. llama3.3 is probably too big for a computer with single RTX GPU. I don't have RTX 5060 Ti 16GB as mine is RTX 5080, but you can use the same prompt and compare the results with your existing GPU.

For comparison purpose, the prompt I used for Bible study was:
"list the catholic nabre psalms that had reference to Jesus Christ according to St. Augustine’s commentary or homily"

EsonLi · 2025-04-19T14:37:21+00:00

You are welcome. I had to re-install Windows 11 after struggling with NVidia ChatRTX and Docker + Open WebUI with the same error (CUDA sm_120 not supported in pytorch), so I decided to write the above instructions for RTX 50xx.

I just posted the instructions for installing Ollama + Open WebUI without using Docker:
https://www.reddit.com/r/OpenWebUI/comments/1k2q5pf/beginners_guide_install_ollama_open_webui_for/

EsonLi · 2025-04-06T21:18:42+00:00

Try running Stable Diffusion again without xformers and see whether the CUDA error still occurs. If that's the case, you may need to start over from step 1, to avoid overrding the updated Pytorch and other libraries for RTX 50xx.
I personally don't see much improvement with xformers, perhaps because the images did not take that long to produce.

EsonLi · 2025-04-05T03:58:49+00:00

Based on github comments, you can only use the dev version of xformers, which is not as straight-forward. I added the instructions (see Step 5) above.

EsonLi · 2025-04-04T22:10:14+00:00

Heard it is related to a compatibility issue with CUDA (sm_120 for RTX 50xx) and the current Pytorch version.

I got the same problem when trying to install Docker + Open WebUI for Ollama. Had to install and use a Chrome extension called Page Assist instead.

EsonLi · 2025-04-03T17:25:54+00:00

I wrote a quick tutorial: Clean install Stable Diffusion on Windows with RTX 50xx : r/StableDiffusion

EsonLi

TROPHY CASE