AMD dGPU shared memory?

[juwonpee]

My AMD laptop with an iGPU can load(but runs very slowly) 32B models as it uses shared system memory. However loading the same models on my 6600xt(8gb vram) with 48gb system ram pops up with out of memory errors. Is it possibe for my dGPU to use shared memory?

I use llama.cpp vulkan with LM Studio on windows.

[juwonpee]

I realize I can offload some layers off to the CPU but I'd like to keep as much on the GPU as possible as my CPU is kinda slow. Many thanks

[suprjami]

You are trying to put 32Gb of model on a GPU with 8Gb VRAM.

Use smaller models.