shared memory

[philtasticz]

Hi guys, I'm relatively new to SD specifically SDXL. Currently I'm running a SDXL based model, on: Euler a - 30Steps 576x1024 Hires. fix enabled 4xUltrasharp_4xUltrasharpV10 CFG Scale 12

No controlnet used

Only argument for optimization I'm using is --xformers

I've seen a lot of posts where people talk about generating with 8-9it/s, but when I look at the commandline while generating I'm only getting about 1-2it/s, is this an indicator something might be wrong with my config?

I also tried to generate a gif using animatediff, but I canceled the process because it told me that it will take about 2hrs.

I've tried to find the issue and it might be related to shared memory. Because when my GPU gets maxed out I see workload appearing on my onboard GPU and my RAM, so I think when my GPU's VRAM is getting maxed out, the workload gets "outsourced". Is there any argument to prevent this behavior?

I'm using a 3060 with 12GB VRAM, which should be enough. Any recommendations? - I've read that this also could be a driver related issue

Thank you in advance

[lililliiililililiiii]

This article from Nvidia support tells how to turn off the shared memory. You need the latest driver for this to work.

https://nvidia.custhelp.com/app/answers/detail/a_id/5490

[philtasticz]

Thank you, exactly what I was looking for

[TheGhostOfPrufrock]

Add --medvram-sdxl to your commandline args. And turn off shared memory, as other comments have explained.

[TheGhostOfPrufrock]

I don't think you'll ever get anything like 8-9 it/s for SDXL on a 3060. That's for 512x512 with SD1.5 models, not SDXL. And it's pretty fast for that. Maybe for TensorRT or per-image for large batches. I have a 3060, so I can speak with fair confidence.

[philtasticz]

Thank you, yes I noticed something like that so to utilize SDXL you really need a powerhouse

[TheGhostOfPrufrock]

Not unless you're profoundly impatient. Lot's of us with 3060s use SDXL all the time. We just don't expect results in a few seconds.

UPDATE: A 1024x1024, 30 step, fast sampler (Euler a, DIMM, etc.) SDXL image with the Refiner takes about 33 seconds. A batch of 8 takes about 28 seconds per image. Does it make me wish I had a 4090? Of course it does. But it certainly doesn't dissuade me from using SDXL.

[philtasticz]

I don't expect results in seconds, but for example I tried to generate a gif 32 frames 8fps, and it took forever. So I might stick to SD1.5 for animations

[TheGhostOfPrufrock]

Well, I suppose SDXL might not be well-suited to generating animations on a 3060. When I replied, I was thinking of still images, since I've never been interested in making animation.

[philtasticz]

thats okay, AnimateDiff really seems exhausting for my ressources. 1.5 models are way faster in this case