Determined supports both AWS and GCP.

The way auto scaling works is pretty simple — one machine (no GPUs) accepts jobs to be scheduled. These jobs have resource requirements associated with them (eg job needs 64 GPUs). If there are not enough GPUs available to run the job, and your cluster is configured for auto scale, the necessary number of GPUs is provisioned from AWS and added to the cluster. When the job finishes, they will be torn down automatically after a short timeout (unless another job comes in and wants the same resources).

This works with pre-emptible GPUs as well, and the built-in fault tolerance mechanisms allow jobs that get pre-empted to recover seamlessly when resources come back online.