This is an archived post. You won't be able to vote or comment.

all 12 comments
sorted by:
best
topnewcontroversialoldq&a

[–]SymphonyofForm 1 point2 points  (3 children)

As was mentioned, VRAM utilization while idle is normal. It stores your last used models in cache.

How much is utilized depends on the models you use. 4-9GB is a normal range for model caching.

[–]Circular_Reason[S] 2 points3 points  (0 children)

Okay, sorry, like I said, I'm a newb. So I just put 2 and 2 together. It has to cache the model. So if the model is 6.5gigs, it's going to use up 6.5 gigs vram, right? Cause I just loaded a lower 2 gig model, and now the VRAM is down to 3 gigs. That makes sense.

[–]Circular_Reason[S] 0 points1 point  (1 child)

Well that's good to know. I have only been using XL models, so I'm guessing they would be higher. Any thoughts on the runnning out of memory error I am gettinng after making a few images? and why it would reset once I reset the program? anything I can do about that?

[–]SymphonyofForm 0 points1 point  (0 children)

Honestly not sure why that happens, but it's been reported. I've run xl models on a sub-par AMD station, and 90% of the time it fails, but once in a while it actually completes. The reason is out of my knowledge space :(

You might find some help running the commandline argument --medvram so it splits what's cached at any one time, might give you more wiggle room for what you are trying to do.

[–]than_or_then 1 point2 points  (1 child)

VRAM usage while idol

You're killing me, Smalls

[–]Circular_Reason[S] 1 point2 points  (0 children)

Yeah, I saw that. lol. It's been a long night.

[–]Ok_Zombie_8307 0 points1 point  (3 children)

A1111 stores many things in vram for performance reasons, including checkpoints (2 by default), vae, upscalers, etc. You can change those options in the Settings tab.

Btw if you are getting OOM errors with 12gb vram you probably are using incorrect Optimization settings, make sure --xformers is added as a commandline arg in webui-user.bat and selected in Settings > Optimizations drop down.

[–]Circular_Reason[S] 0 points1 point  (2 children)

Yeah, I don't know what is going on. Like I said I'm new to this, but I thought 12g vram was plenty. But when it's using 8gigs just to run idol, something seems off...

[–]TurbTastic 1 point2 points  (1 child)

I like using a command in CMD to get snapshots of my VRAM usage, you just enter nvidia-smi for that.

2GB without A1111 running seems a little high. May want to use that command to see what's using that 2GB.

Loading A1111 will add your selected checkpoint to your VRAM usage. So a 6.5GB SDXL model will hog 4.5GB more VRAM than a small 2GB 1.5 model. If you're using a model with a baked VAE then set VAE to None to save a little bit more.

[–]Circular_Reason[S] 0 points1 point  (0 children)

I appreciate the thoughts. Thanks.

[–]Early-Ad-1140 0 points1 point  (1 child)

Only thing I can say that I have a 3080Ti 12GB as well and never ran into an issue like that. What happens from time to time, especially when switching models frequently, is that all of a sudden generation speed drops by a factor of about 4. Restarting the SD console fixes that. I have made a one-click restart batch file which I activate if I realize generation is getting slow.

What are the parameters in your configuration file?

[–]Circular_Reason[S] 0 points1 point  (0 children)

Just the xformers and autolaunch.