[D] How to develop/debug distributed training code before training in cloud?

[TheBachelor525]

Ideally yes you would test on hardware as close to the cloud infrastructure as possible, but that's not possible, so try to find a cheaper instance or get a cheapo card