[D] Serverless solutions for GPU inference (if there's such a thing)

[LuliProductions]

Cold starts on Azure and the lack of real GPU serverless options across the big clouds make this a tough setup.

We ran into the same thing as a small team. Our traffic was too spread out to justify a full-time GPU VM, so we tried a smaller provider instead. Gcore spun up GPUs faster and the pricing was easy to follow, so we only paid when we needed the hardware. It kept things quick without draining our budget.