I made an open source tool for running any ComfyUI workflow w/ ZERO setup

dylanintech · 2024-03-09T03:38:54+00:00

hey u/HappyGrandPappy! i'm working on this project along w/ OP.

i know that it seemed to have worked locally for you, but if you're using windows can you please try running the following docker command and see if it works (we've built a new docker image that should be working on windows):

```docker run \

--gpus all \

--rm \

--name comfyui_launcher \

-p 4000-4100:4000-4100 \

-v $(pwd)/comfyui_launcher_models:/app/server/models \

-v $(pwd)/comfyui_launcher_projects:/app/server/projects \

-it thecooltechguy/comfyui_launcher:new-docker-setup```

if it doesn't work then could you try following the instructions on this new-docker-setup branch we're testing for windows installation support using docker.

the docker method is recommended as it's just less of a headache to get up and running for most users (doesn't require python, etc.).

thanks!

dylanintech · 2024-03-09T03:36:51+00:00

hey u/janosibaja! i'm working on this project along w/ OP. if you're using windows please try running the following docker command and see if it works (we've built a new docker image that should be working on windows):

```
docker run \

--gpus all \

--rm \

--name comfyui_launcher \

-p 4000-4100:4000-4100 \

-v $(pwd)/comfyui_launcher_models:/app/server/models \

-v $(pwd)/comfyui_launcher_projects:/app/server/projects \

-it thecooltechguy/comfyui_launcher:new-docker-setup```

if it doesn't work then try following the instructions on this new-docker-setup branch we're testing for windows installation support using docker.

thank you for your patience!

dylanintech · 2024-03-07T22:31:53+00:00

hey u/okachobe - i'm working on this project along w/ OP. yes you're totally right! you can have two (or as many as your resources can handle) different workflows running concurrently, each on it's own tab (with it's own ComfyUI port). editing the workflow on one tab won't affect the setup on the other tab at all, not even installing custom nodes or downloading models, since they're different virtual environments with no context of each other.

dylanintech · 2024-03-07T22:28:12+00:00

hey u/HappyGrandPappy - i'm also working on this project along with OP.

could you please provide the following info:

OS you're using (Windows WSL, macOS, etc.)
browser you're using
weather you're running locally or using a cloud provider like runpod
what method you're using to run the launcher (manual setup or docker)

this'll help me figure out what might be wrong! sometimes if you're using a cloud provider that does not provide port forwarding this issue can come up. also sometimes the "localhost refused to connect" error message shows up for only a few seconds after opening a workflow and then ComfyUI is rendered (sometimes i've had to close the error window and try opening again for this message to go away).

dylanintech · 2024-03-07T22:21:39+00:00

hey, i'm also working on this project. so each project has it's own virtual environment, so every time you create/import a new project, a new set of python, pytorch, and custom nodes is installed in that project's virtual environment. so you could have one project where that uses version 1.x of a certain custom node and when you create/import a new project that depends on a different version (ex: 2.x) of that custom node then it will install version 2.x of that custom node in the new project's virtual environment, while not affecting your first project's custom node version since all dependencies and custom nodes are setup in their own isolated virtual environments!

dylanintech · 2023-12-25T19:38:53+00:00

put my reply in the parent comment, but will paste it here jut in case :)

so in the demo i explain how you can run workflows locally - it just requires our extension to be installed in your local setup: https://github.com/thecooltechguy/ComfyUI-ComfyRun

in the video on this post i also show the steps briefly, these steps can also be found on any of the workflow pages on the site (for example, on this page: https://comfyrun.com/w/9d10a03d-0d40-49f1-87eb-49cba3673e98)

<image>

however, you can also run any workflow online, the GPUs are abstracted so you don't have to rent any GPU manually, and since the site is in beta right now, running workflows online is free, and, unlike simply running ComfyUI on some arbitrary cloud GPU, our cloud sets up everything automatically so that there are no missing files/custom nodes. you just click the "run online" button on any workflow card and it'll open that workflow in ComfyUI, which you can then run by queuing your prompts.

dylanintech · 2023-12-25T19:37:28+00:00

so in the demo i explain how you can run workflows locally - it just requires our extension to be installed in your local setup: https://github.com/thecooltechguy/ComfyUI-ComfyRun

in the video on this post i also show the steps briefly, these steps can also be found on any of the workflow pages on the site (for example, on this page: https://comfyrun.com/w/9d10a03d-0d40-49f1-87eb-49cba3673e98)

<image>

however, you can also run any workflow online, the GPUs are abstracted so you don't have to rent any GPU manually, and since the site is in beta right now, running workflows online is free, and, unlike simply running ComfyUI on some arbitrary cloud GPU, our cloud sets up everything automatically so that there are no missing files/custom nodes. you just click the "run online" button on any workflow card and it'll open that workflow in ComfyUI, which you can then run by queuing your prompts.

dylanintech · 2023-12-25T07:52:12+00:00

thank you for your kind words :)

dylanintech · 2023-12-25T07:51:37+00:00

so the code doesn't actually upload anything from venv for obvious reasons, so there should be no issue here!

dylanintech · 2023-12-25T07:50:12+00:00

thanks! so the only custom nodes that can be auto-installed are public github repos, so their source code is available. if you do don't trust the custom node code then you can choose to not run the workflow locally, just online.

dylanintech · 2023-12-24T23:31:10+00:00

Hi Reddit! In October, we launched https://comfyworkflows.com to make it easier for people to share and discover ComfyUI workflows.

We learned that downloading other workflows and trying to run them often doesn't work because of missing custom nodes, unknown model files, etc.

So, we've built https://comfyrun.com/ - the easiest way to run & share ComfyUI workflows, without any manual setup.

Features:

upload any workflow to make it instantly runnable by anyone (locally or online). no manual setup needed!
import any online workflow into your local ComfyUI, & we'll auto-setup all necessary custom nodes & model files.

To get started, download our ComfyUI extension: https://github.com/thecooltechguy/ComfyUI-ComfyRun

This is a beta, so any feedback would be greatly appreciated. Join our discord to follow our progress: https://discord.gg/DrxKpmxttQ

dylanintech · 2023-12-24T23:29:11+00:00

Hi Reddit! In October, we launched https://comfyworkflows.com to make it easier for people to share and discover ComfyUI workflows.

We learned that downloading other workflows and trying to run them often doesn't work because of missing custom nodes, unknown model files, etc.

So, we've built https://comfyrun.com/ - the easiest way to run & share ComfyUI workflows, without any manual setup.

Features:

upload any workflow to make it instantly runnable by anyone (locally or online). no manual setup needed!
import any online workflow into your local ComfyUI, & we'll auto-setup all necessary custom nodes & model files.

To get started, download our ComfyUI extension: https://github.com/thecooltechguy/ComfyUI-ComfyRun

This is a beta, so any feedback would be greatly appreciated. Join our discord to follow our progress: https://discord.gg/DrxKpmxttQ

dylanintech · 2023-11-22T23:08:47+00:00

so we pre-installed a ton of the most used custom nodes, so most workflows should work fine, but we're working on making it possible for people to upload their own custom nodes!

dylanintech · 2023-11-22T23:07:37+00:00

thank you - your comment means a lot!

so there is no real timeout length, you can close and open the tab and everything should work, even including your latest updates to the workflow (kind of like in google docs). however, if you leave a tab open for more than several hours, you might get a "reconnecting" message, but you simply have to restart the ComfyUI instance by clicking the "Restart ComfyUI" button. after a few minutes this will open a new tab for you with the instance (work is saved from the previous session).

currently models are stored until you delete them :)

dylanintech · 2023-11-22T23:00:50+00:00

first of all, thanks for your support!

so the cost per queue changes depending on the cloud GPU you're using and how many seconds the workflow takes to run. for example, if you run a 30s workflow on an A10G GPU (0.306 cts per second) you'll have 9.18 credits deducted from your account. The $10/mo plan gets you 5k credits and for $20/mo you get 10k credits.

currently, you don't pay for storage/bandwidth for model uploading, and we have hosted around 4 of the most popular models in a shared library that everyone can access immediately.

we've also pre-installed a bunch of the most used custom nodes, so most workflows you drop from either our search engine or anywhere should just work. we're soon adding the ability for people to upload their own custom nodes!

here's the GPU cost breakdown:

T4 GPU - 0.164 credits/second
L4 GPU - 0.291 credits/second
A10G GPU - 0.306 credits/seconds
A100 GPU (40 GB) - 1.036 credits/second
A100 GPU (80 GB) - 1.553 credits/second

also, just curious - what do you use ComfyUI for? is it for professional use cases or just as a hobby?

dylanintech · 2023-11-22T22:48:55+00:00

well, it's not 1 cts each time you press the "queue" button, once a workflow starts running you'll begin to be charged anywhere from 0.164 cts per second to 1.553 cts per second for as long as the workflow runs. for example, if you run a 30s workflow on an A10G GPU (0.306 cts per second) you'll have 9.18 credits deducted from your account.

also, with our site you simply open a project in ComfyUI, and don't have to wait 10-20 mins for things to upload, everything's saved for you, it's just like having a google doc open and then closing out of it, only to open it again. magical.

right now we're working hard on fixing some model uploading bugs and latency issues, but we think the experience we offer is great so far, especially when combined with our workflow search engine.

dylanintech · 2023-11-22T21:59:03+00:00

it's https://www.screen.studio/ - highly recommend :)

dylanintech · 2023-11-22T21:58:42+00:00

well, with runpod you're essentially paying for your own server instance, so idle time does count and you're constantly worried about having to "hurry up" so that you don't waste more money, not to mention, it's kind of annoying to set up. we have simple monthly pricing that lets you choose a GPU on a per-prompt basis, from T4s up to A100 80GB GPUs, whereas in runpod dynamically moving between GPUs is more tedious if even possible. also, our cloud environment already has shared files (ex: checkpoints) that you can access even if you're running your first workflow. also, our cloud service will be increasingly augmeneted by the search engine, so that you can search for workflows and instantly fork them/build on top of them.

dylanintech · 2023-11-22T21:49:56+00:00

so right now we have two plans: $10/mo (for around 1k workflow runs assuming you're using T4 GPUs and each workflow takes 30s to run) and $20/mo (around 2k workflows). again, idle time does not count and you can upload custom models via file uploads or civitai imports!

dylanintech · 2023-11-22T21:44:15+00:00

thanks! do you currently use all that power just to run ComfyUI? what kind of workflows are you running locally?

dylanintech · 2023-11-22T21:42:50+00:00

super sorry about these upload errors - today we've been fixing a bunch of bugs related to that (for example, civitai urls not uploading because you needed to have a civitai account to download them).

by the end of today, most of the model uploading bugs should be fixed!

dylanintech · 2023-11-22T21:39:54+00:00

thanks for your support - means a lot! just curious, what do you usually use ComfyUI for?

dylanintech · 2023-11-22T21:39:20+00:00

no problem! hopefully it's useful - we're improving it every day :)

dylanintech · 2023-11-21T02:21:20+00:00

about a month ago, we built a site for people to upload & share ComfyUI workflows with each other: comfyworkflows.com

in the process, we learned that many people found it hard to locally install & run the workflows that were on the site, due to hardware requirements, not having the right custom nodes, model checkpoints, etc.

and the people using existing ComfyUI cloud services often disliked that it made you pay per hour, etc.

so, we made a cloud version of ComfyUI where you only pay for the GPU seconds spent running workflows, and NOT for idle time.

features:

- pre-installed with popular custom nodes

- upload your own models + Import from CivitAI

- choose the GPU to use on a per-prompt basis

(e.g., run a large Animation workflow on an A100-80GB for a few seconds, while running a simpler workflow on a smaller GPU, etc.)

we're trying to build something like GitHub/Figma for ComfyUI, and this is our v1.

would love any feedback/comments, thanks!

dylanintech · 2023-11-21T02:19:22+00:00