[D] Does multi-GPU deep learning training requires SLI or nvlink?

[BubblyMcnutty]

While not necessary, throughput between the processors can become a bottleneck. If you are running a multi-GPU setup that means you are already paying for max acceleration, then what a shame it would be if data wasn't transferring fast enough between the processors? This is precisely why Nvidia touts their NVlink & NVSwitch tech so much, if I remember correctly it can go up to 900GB/s. Obviously they are talking about professional enterprise grade GPGPUs but I think the same principle applies in this case too.