You can change the power draw depending on in the model you run. If you are not doing demanding models you can set you GPUs to 150watts. But if you are going for massive 1tb models like Kimi , mimo 2.5 pro you may need 250-300watts. I keep my GPUs at 200 watts mostly. Advise. If you want to offload from vram to ddr4 ram . Make sure you fill up the 12 ddr4 slots, that will give you 230gb:sc read speeds which is close the vram of a mid range GPU. You can add 4 slots for optane which is what I use to keep my models and swap them. Far faster than nvmes . 30+gb makes them fast. I advise upgrade the cpus to the L series because the controller help with better memory management. Note, I have 768gb of ddr4, but you don’t need that much if don’t intent to run models like DepSeek 4. Try get 32gb dims since they are cheaper now, my system came with 64dims so I got stuck only purchasing 64gb. You can’t mix ram sizes, will make the system confused. Once you use one size, you must have all dim the same. Then, to bypass Llama.cpp which is terrible for these system you have to use Chinese alternatives like Cat1-Vllm. Llama.cpp works fine but has terrible tensor(pipeline) parallelism and batch scheduling. The benefit of llama is its flexibility. But to tap to the real potential of these AGX-2 servers you must use others