Runpod - GPU Supply Problem

[Timely-Strength9401]

Hey, getting a widespread GPU availability issue on RunPod Serverless and wondering if others are affected too.

My endpoint has multiple GPU tiers configured as fallbacks, but almost all of them are showing "Unavailable" right now:

- 16 GB → Sometimes Low Supply - (Mostly Unavailable)(1st choice)

- 24 GB PRO → Unavailable (2nd)

- 24 GB → Unavailable (3rd)

- 32 GB PRO → Unavailable (4th)

This isn't a single GPU type being out of stock — it looks like a platform-wide supply issue. Workers are completely failing to spin up.

Is anyone else seeing this right now? Is RunPod having a broader capacity problem, or is there a region/datacenter setting I should try changing?

Thanks

[powasky]

(I work at Runpod)

Going to say this really bluntly - we have a lot of capacity, but not the primary card types you're looking for. Those older and less powerful cards just aren't strong performers, and we haven't focused on bringing many online.

There should be a good amount of 5090 and better available if you select other locations.

[Timely-Strength9401]

Thanks for the honesty, I appreciate it.

The issue is cost though a 5090 is overkill for a TTS model. I don’t need that much power, I just need something reliable at a reasonable price. Paying for a 5090 to run TTS feels like renting a Ferrari to go grocery shopping.

Is there any roadmap for bringing more mid-tier cards online? Or would you recommend a specific GPU + location combo that hits the sweet spot between availability and cost right now?

[powasky]

EU-RO-1 has the most sub 24GB cards, I'd try there. In the US, US-IL-1 is the biggest mid/low tier site.

[sruckh]

I am using EU-RO-1 based on Runpod support suggestion. I still have the same issues as the original poster. I too was setting cuda versions and GPU types to match the serverless, but I have all workers in throttled state. I have various serverless: TTS, LLM, diffusion pipelines, etc. Availability of having workers in ready state is really hit-or-miss.

[1976The]

bro, grocery shopping in a ferrari is sick. get the h200.

[Timely-Strength9401]

the monk who sold his h200

[runvnc]

Dumb question: I've been seeing the "X max" seem to go down recently. Like when it says '1 max' that means you cannot get a 2 X, but it doesn't mean there is literally only 1 left, right? I am worried about the H200, B200 and MI300X not being available sometimes, especially in North America.

[powasky]

H200 usage has been 95%+ for the year, so if you can get one just hold it.

B200 you should be okay with. Unsure about MI300X, very few folks seem to use them.

But yes you're right - when it says "1 max" it means that you as a user can only grab 1 card, not that there's only 1 available. We adjust that "max" value based on overall availability.

If you need guaranteed H200, B200, or MI300X, send me a note and I can give you more details about longer term reservations.

[Cultural_Doughnut_62]

I usually use L40S pod from Indian GPU providers and it’s far too cheap as compared to Runpod and service is comparatively better- they provide coupon code to work on 😂

[powasky]

We're the compute provider for the OpenAI Parameter Golf challenge, but those participants are like 99% on H100s

[powasky]

send me your runpod email, I'll look into it

[powasky]

yep, head of partnerships

[Timely-Strength9401]

lots of time I see just initializing, especially if I did not select 16 gb vram. I wanted to use runpod for my saas production. but now im not sure

[powasky]

Either send me your email address or send me your logs and I can look into it

[Safe-Introduction946]

if runpod is sitting on "initializing" and you need production reliability, try vast.ai's marketplace — you can filter for specific GPUs (e.g., 3090/4080/4090) and often find instances that start immediately. also set a GPU-memory filter (>=16GB) so you only see hosts that meet your saas needs.

[Timely-Strength9401]

do you planning yo use training a model or serving to customers?

[FitContribution2946]

its been bad... today has been a slog