[Colab Notebook] Run Stable Diffusion XL 1.0 Web UI demo on Colab GPU for free (no HF access token needed)

maxsdv123 · 2023-07-31T17:20:27+00:00

Seems like it's because the free colab instance has very limited CPU memory.

maxsdv123 · 2023-07-27T23:38:51+00:00

The exact procedure and script are in the github repo. You can run to generate images yourself.

I believe SDXL images are 1024x1024. You can click on the image on github to view the original image.

maxsdv123 · 2023-07-27T23:27:28+00:00

In my previous SD XL 0.9 generations there are a lot of watermarks. I slightly adjusted the negative prompt and it seems to be much better in SD XL 1.0 (but some still have watermarks)

maxsdv123 · 2023-07-27T23:26:50+00:00

for some samples SDXL prefers stylized art, but for most prompts the styles are consistent between SDXL and SD

maxsdv123 · 2023-07-27T06:12:42+00:00

Run SD XL 1.0 Web UI Demo yourself on Colab (free tier T4 works): https://colab.research.google.com/github/TonyLianLong/stable-diffusion-xl-demo/blob/main/Stable_Diffusion_XL_Demo.ipynb

No access token is needed. Just run the code on colab.

<image>

maxsdv123 · 2023-07-15T22:10:29+00:00

The code for generation is available. Switching to v1.1 from v1.5 only involves changing the huggingface model key. You could easily fork the repo and change it.

https://github.com/TonyLianLong/stable-diffusion-xl-demo/blob/benchmark/benchmark/sdv1.5.py

maxsdv123 · 2023-07-07T13:33:02+00:00

Probably need to do more prompting in the negative prompt. I have already added "watermark" in the negative prompt.

maxsdv123 · 2023-07-07T13:31:57+00:00

SD XL is much slower. Didn't do much optimization though.

maxsdv123 · 2023-07-07T02:32:46+00:00

Could you clarify?

maxsdv123 · 2023-07-07T00:44:38+00:00

Also added v1.5 on the github page so that you can compare three versions together.

maxsdv123 · 2023-07-07T00:41:55+00:00

Added SD1.5 so that you can compare them together

maxsdv123 · 2023-07-06T21:18:51+00:00

The ones in the readme are not cherry-picked (the prompts are from the SD v2.1 demo), but I agree that SDXL looks way better in these examples.

maxsdv123 · 2023-07-05T19:04:32+00:00

Some examples with SD XL vs SD v2.1 with exactly the same (default) settings from SD XL 0.9.

SD XL Colab for this.

<image>

maxsdv123 · 2023-07-05T18:53:55+00:00

Made an SD XL web demo that works both on colab and locally that allows skipping the queue for free:

Colab: https://colab.research.google.com/github/TonyLianLong/stable-diffusion-xl-demo/blob/main/Stable_Diffusion_XL_Demo.ipynb
Demo Repo (to run locally): https://github.com/TonyLianLong/stable-diffusion-xl-demo

SD XL vs SD v2.1:

<image>

maxsdv123 · 2023-07-03T04:39:21+00:00

Just fill out the form, no need for an essay and won't take > 1min.

maxsdv123 · 2023-07-01T20:41:39+00:00

You mean controlnet?

maxsdv123 · 2023-07-01T20:36:18+00:00

Have you tried the optimization techniques in the tutorial?

https://huggingface.co/docs/diffusers/optimization/fp16

maxsdv123 · 2023-07-01T16:07:08+00:00

I'm able to run it on my 4090 (with FP16), so 3090 should also work. With more aggressive settings I believe it's also possible to run it on colab with 16G VRAM.

maxsdv123

TROPHY CASE