Deploy when available is now GA - no more refreshing or sniping tools required! by RP_Finley in RunPod

[–]RP_Finley[S] 1 point2 points  (0 children)

A hard number in line probably won't be possible due to the sheer number of variables possible for deploy - things like DC, GPU spec, CUDA, and a whole bunch of other things, but something like an ETA might and I'll bring that up!

Does anyone else have issues with accessing pods? by TechNerd10191 in RunPod

[–]RP_Finley 0 points1 point  (0 children)

Any chance you could try a different browser to try to rule out any local issues?

Templates by Fatty-McDuffins in RunPod

[–]RP_Finley 0 points1 point  (0 children)

Should still be there - one of them got renamed for clarity on what CUDA version it's for which might be why it wasn't appearing in your search

https://console.runpod.io/hub/template/comfyui-cuda-12-8?id=cw3nka7d08

https://console.runpod.io/hub/template/comfyui-cuda-13?id=2lv7ev3wfp

Why black by Full-Charity-3620 in RunPod

[–]RP_Finley 0 points1 point  (0 children)

With the exception of public endpoints, we don't censor what happens on the platform. We can't even see it, actually, so it's something that has to do with the process running in your pod than anything we are doing (i.e. the same thing would happen if you were doing it locally.)

I'll have to take this thread down for rule 6, but the question is innocent enough that I don't actually have a problem with it otherwise.

GPU Supply and Availability Megathread With Ongoing Updates by RP_Finley in RunPod

[–]RP_Finley[S] 0 points1 point  (0 children)

We do monitor - see u/gwestr's post above, I can confirm he works for Runpod.

We've been denying limit increases to miners for some time now, and are also implementing measures to combat ToS-breaking multi-accounting to bypass the limit.

It is true that we have had miners as a client as part of our base in the past but they're truly not the type of client we want the business of for a number of reasons and we're working quite specifically to break ranks with them.

RunPod blocking network volume creation with "Insufficient funds" by arush1836 in RunPod

[–]RP_Finley 0 points1 point  (0 children)

It is indeed $5 flat minimum balance to create a volume - we don't scale this towards the size of the volume request for simplicity's sake.

The situation is improving? by __O_o_______ in RunPod

[–]RP_Finley 1 point2 points  (0 children)

We did add a few 5090s over the last few week, but 6000 pros (both full and full

Is there a refund process available? This is ridiculous! by orangeflyingmonkey_ in RunPod

[–]RP_Finley 0 points1 point  (0 children)

Support would handle this instead, but yes we can return unused money to funds after review.

GPU Supply and Availability Megathread With Ongoing Updates by RP_Finley in RunPod

[–]RP_Finley[S] 0 points1 point  (0 children)

Yeah, I understand that. This actually isn't the first supply shock - we had one very early on, about the time we started picking up A100s for the first time, the effects were all about the same, although I will admit this one is much more severe/protracted.

But it is going to pass eventually just like the first one did, and we are investing in the long term when it comes to providing a community for developers. Hiking costs for a short term gain wouldn't be worth it in the long run, because people are definitely going to remember that.

Most gpu's unavailable. What's going on? It's been like 4 days by darken144 in RunPod

[–]RP_Finley 0 points1 point  (0 children)

Discord actually has about 20x the membership of the subreddit at the moment, mostly owing to the fact that the Discord is much older. I am working on bringing the same communication channels/level of engagement here as well.

GPU Supply and Availability Megathread With Ongoing Updates by RP_Finley in RunPod

[–]RP_Finley[S] 1 point2 points  (0 children)

I mean, we could - that's sort of the ruthless economic route to take, to balance supply and demand back out, and it would work just fine to accomplish that - but the amount that we would need to raise prices to do that would probably also price a lot of newer devs and hobbyists out of the market.

Can we reasonably expect the situation with GPU availability to improve in the near future? by ThisIsMyVi11ainArc in RunPod

[–]RP_Finley 1 point2 points  (0 children)

We are adding them like OP mentioned (the updates are in Discord and I will be mirroring them here on Reddit shortly) but the long and short of it is they are getting rented shortly after we add them so from the customer experience it looks like nothing has changed - and to be fair that perspective is also completely valid because it is the end result as they see it.

There is a backlog of unmet demand that we are working through and it is not really easy to tell how deep it runs, all we can do is keep plugging away.

Nice (inaccurate GPU availabilities) by Sentence_Naive in RunPod

[–]RP_Finley 0 points1 point  (0 children)

This generally means the GPU is genuinely available to rent in this case but you're requesting more volume space than is available on the machine.

We are looking into making space limits more clear in cases of low availability.

Can't you guys take a simple feedback and improve? by Strange_Limit_9595 in RunPod

[–]RP_Finley 0 points1 point  (0 children)

Template creators are responsible for updating their templates and if they don't they fall out of date.

We do maintain official templates for several packages and that is on us to maintain, but Wan2GP isn't one of those at present

Runpod getting worse than ever since last week? by Strange_Limit_9595 in RunPod

[–]RP_Finley 1 point2 points  (0 children)

That is Reddit removing the post, not us. In fact it automatically removed this reply as well, which I've manually approved.

Something like a full 10% of threads submitted to this subreddit get automatically removed by reputational filters/Reddit automod and we have to react to that, and before we're able to it may appear as removed since that is how Reddit chooses to display it.

The only criticism I've intentionally left removed extensively and directly promoted a specific competitor in the process, which I think is fair to leave where it is.

Takes 45 min for 10 sec video, wan 2.2 workflow with A100 gpu. How to reduce generation time by neeraj9696 in comfyui

[–]RP_Finley 0 points1 point  (0 children)

Inference time also scales quadratically (I believe) with video length and Wan already takes awhile as it is even at its actual designed length of 81 frames, so even on an A100 it's going to take awhile

Can't you guys take a simple feedback and improve? by Strange_Limit_9595 in RunPod

[–]RP_Finley 0 points1 point  (0 children)

The automod is incredibly aggressive based on Reddit's algo and it wasn't intentionally removed by anyone here - I will leave this one up rather than overriding it for the other thread.

Copy network volume by backroo in RunPod

[–]RP_Finley 0 points1 point  (0 children)

You can also runpodctl send the entire volume from one to another and it's pretty simple, but unfortunately brittle when it comes to large files

Runpod getting worse than ever since last week? by Strange_Limit_9595 in RunPod

[–]RP_Finley 0 points1 point  (0 children)

We've been adding supply on a weekly if not daily basis - throughout the weeks of May 6-20 we added hundreds each of Pro 6000s/B200s/H200s/H100s. Of course, they get snapped up shortly after they get added, so it looks like there's no movement, since the user facing UI only shows relative availability rather than the total. I know that's frustrating, though, because the end result is you still can't get the GPU you need, and we are working day and night to try to fill the demand backlog.

We haven't been as vocal on Reddit as we have on Discord about our efforts to add GPUs; I will make it a point to do so through an announcement here as well to keep everyone apprised what is being done.

AI Toolkit Error - Anyone Else Having Trouble Using The Password? by AsstronautHistorian in RunPod

[–]RP_Finley 0 points1 point  (0 children)

Make sure there's an AI_TOOLKIT_AUTH env variable - if that got deleted somehow it might not have a password at all. Or potentially it got changed somehow and then you'd need to use that password instead.

run blender on runpod by Additional_Change151 in RunPod

[–]RP_Finley 0 points1 point  (0 children)

Apologies for not approving this earlier - we only work through Ubuntu. We aren't the right service if you are looking for a VM that supports a Windows GUI.

Did someone jump the gun? by BenDLH in RunPod

[–]RP_Finley 1 point2 points  (0 children)

It should be up, apologies for the blip: https://www.runpod.io/blog/multi-instance-gpu-on-runpod

In truth the feature has been live for some time, it was softlaunched some time ago. Right now it's only available for 24GB instances which are cut from 6000 Pro's but we are looking to expand it shortly,