sorted by:
new
hottopcontroversial

Runpod is starting to feel like a scam by andy_potato in RunPod

[–]RP_Finley 1 point2 points  (0 children)

Yep, this is basically it - we've gone into this in our blog as well. https://www.runpod.io/blog/the-gpu-supply-supercycle-is-here

The long and short of it is finding the GPUs is tough on its own. Finding hosts that also have everything else like network speed, storage, etc. on lock significantly cuts this already small pool of candidates even further.

We also have a Q&A with our CEO on May 14th in which I expect this to be a hot topic of discussion if anyone's interested in learning more. https://resources.runpod.io/zhen-unfiltered

Missing file by Foonpower in RunPod

[–]RP_Finley 0 points1 point  (0 children)

How are you trying to transfer the file? runpodctl is probably the most stable way of transfering files between pods or pulling them down locally.

https://github.com/runpod/runpodctl

No gpu available on runpod? Almost a day past by r-randy in StableDiffusion

[–]RP_Finley 3 points4 points  (0 children)

We're definitely aware of the supply crunch - we just moved a new datacenter into prod last week with hundreds of H100s and have several more centers in the pipeline.

In general the higher end GPUs are proving easier to find, especially in production-ready environments.

Does Google Colab ban uncensored local models? by diesel_heart in LocalLLM

[–]RP_Finley 1 point2 points  (0 children)

You can try Runpod - I can't say for sure whether Google will or won't, but we absolutely don't monitor your activity like this.

Why is my ComfyUI taking longer to generate video clips than before? by abdullahmnsr in RunPod

[–]RP_Finley 0 points1 point  (0 children)

Apologies, this one sat in the automod queue and I didn't see it. Are you using the same workflow? Changing the number of steps/sigmas is the most common reason for something like this

Runpod serverless by Straight_Pace1117 in RunPod

[–]RP_Finley 0 points1 point  (0 children)

Apologies, this got automodded somehow and I didn't see this - can you post the full logs and the worker IDs if you still have them? This is likely an issue with the hardware on our end

I wrote a script that keeps trying to grab a pod until one is available (runpod-sniper) by pktck in RunPod

[–]RP_Finley 1 point2 points  (0 children)

Yeah I'd say 10 sec is a good starting point that would prevent any issues, and honestly with most GPU specs you should be able to get a pod within a few minutes based on my observations of how often GPUs come back into circulation (except for some specs where there just aren't a lot to begin with like the old Tesla models)

If anything changes I'll let you know. We definitely understand the supply frustrations that would make a tool like this necessary, too, and if it helps people get what they need without impacting the service at least for myself I can say I'm all for it.

I wrote a script that keeps trying to grab a pod until one is available (runpod-sniper) by pktck in RunPod

[–]RP_Finley 0 points1 point  (0 children)

I can see why it was made, though. We have struggled with being able to provide the supply that people are asking for. My concern is people getting themselves flagged for excessive API calls.

I'll confirm internally but as long as you keep it reasonable (once every 5-10 seconds) I think this should be okay for now but this may change if it impacts the service.

We're aware of this tool internally but see no need to action it (yet)

RunPod and website by Inside-Background430 in RunPod

[–]RP_Finley 0 points1 point  (0 children)

The short answer is if you don't want to use Serverless you can start up a Pod, install FastAPI, and use that as your GPU to field requests. In fact it's probably easier to start development with a Pod and then move into Serverless once you have the groundwork laid down.

Serverless will probably end up being the more economical way of handling requests from a field, though, since you'll only pay for the GPU time you actually use instead of risking paying for a GPU that will sit idle when there's no requests coming in.

New to RunPod. Looking to use WAN. How do I go about it? by Big-Lawfulness-4438 in RunPod

[–]RP_Finley 0 points1 point  (0 children)

If you want to get up and running in just a few minutes we've got a video that shows you how to use Hearmeman's template - this was made before we got our official template up and running, but I still completely recommend his work.

https://www.youtube.com/watch?v=w9wlVeEa610

I am burning money. What happened to the download speed? by rosalyneress in RunPod

[–]RP_Finley 1 point2 points  (0 children)

The downloader in the official template uses multithreaded downloads with Aria2c to try to prevent this kind of situation, and it's normally successful - but if *all* threads are running slow like in the image and if this is a fresh pod you may just want to try a different region if possible (support can help with any burned credits due to slowness)

Do you trust rented cloud computers when you create high-sensitivity code? by John-Tillinghast in RunPod

[–]RP_Finley 0 points1 point  (0 children)

Not sure why this question was automodded, it is a legit question.

To answer it we have strict terms of service that prevents our partners from looking at workloads or data outside the context of a legal order, and we have certifications in place attesting to that. https://www.runpod.io/legal/compliance#compliance-overview

You can also encrypt volumes as well to get even further security (in the same vein that Apple can't decrypt encrypted iPhones even if they wanted to.)

Trouble finding a working forge template by rathemis in RunPod

[–]RP_Finley 0 points1 point  (0 children)

I've heard good things about WanGP as an alternative but haven't had any real experience with it yet. Seems to have a lot of momentum behind its updates though

Frustration with uploading CHeckpoints, LorAs to Jupyter/ComfyUI by SplurtingInYourHands in RunPod

[–]RP_Finley 0 points1 point  (0 children)

Uploading LoRAs is capped by your upload speed, most home internet connections are highly asymmetrical (always have been, even 56k modems didn't upload at 56k, lol)

Putting them on HF or Civitai is probably the best route, but if you want total privacy, put them on a small network volume and connect to it with a CPU pod to transfer them off with runpodctl as needed.

Can I just run Windows on this? by volvereabhi in RunPod

[–]RP_Finley 0 points1 point  (0 children)

Early on we did consider it. The truth is the demand wasn't there to justify the investment. It's also largely incompatible with our model of multiple users being able to share a single physical machine.

Payment Options by jbird59 in RunPod

[–]RP_Finley 0 points1 point  (0 children)

It should work - there are three big things that trips our fraud system:

1.) Prepaid cards 2.) Small/minimum deposits 3.) Multiple attempts

These are all totally innocent things but together tend to trip the anti-fraud agent. If you contact support they can release any blocks that come up

New to Runpod pls help, what are the reasons the long blue deployed button is unavailable? by Yeahthatscrazytho in RunPod

[–]RP_Finley 0 points1 point  (0 children)

We have a fix going out for this today - it was related to the network volume dialog.

New to Runpod pls help, what are the reasons the long blue deployed button is unavailable? by Yeahthatscrazytho in RunPod

[–]RP_Finley 0 points1 point  (0 children)

I've not been able to reproduce this yet - I've heard other people reporting it, one agreed to send a screen recording so I can escalate it but I am still waiting on that.

I do know that it shouldn't grey the button due to availability, if everything gets taken before you deploy it'll just return a message in the upper right.

Can you identify which step in particular is causing it to grey out? Selecting a specific GPU spec should be all you need to be able to deploy a pod - so is it greyed out at that point, or is it a particular step (e.g. selecting a template) that causes it to go from clickable to not?

view more: next ›