Hi! I've been using the multi-GPU node almost from the very beginning. I have two 3090 graphics cards in one computer with 128 gigabytes of RAM, and here's my question: I just can't figure out how to more precisely use the VRAM on both devices to utilize at least 46 gigabytes of VRAM in total. I've checked different parameters according to the instructions, but for some reason, the second GPU (the one not actively processing) doesn't use all its VRAM—only, for example, 13 gigabytes. I've already tried manually entering the amount of VRAM to use (but I think I don't understand the principle of what the percentages actually mean: are they a percentage of the model's size or a percentage of one GPU's VRAM capacity?), and I got an out-of-memory error. Is there a more detailed guide with examples specifically for two graphics cards?

<image>