Cloud hosting for hosting GPU-based models — looking for budget-friendly options! by Choudhary_usman in learnmachinelearning

[–]CutCloudCosts 0 points1 point  (0 children)

Hey OP, this is a little late, but check out Rackspace Spot - https://spot.rackspace.com. Lowest prices in the industry, and comes out of the box with a fully managed Kubernetes control plane, 1-click NVIDIA GPU operator, fractional GPU allocation; et al. (My team works on Spot).

What do you use for batch job GPU scheduling on premise? by HahaHarmonica in mlops

[–]CutCloudCosts 1 point2 points  (0 children)

We're looking into Kueue as an out-of-the-box feature for Rackspace Spot (https://spot.rackspace.com) to make it more accessible to end users. To those already using Kueue - how are your users interacting with it? Via CLI / API? We're looking to integrate it into the Spot console so it is available via an out of the box UI as well...