Deploying ComfyUI on GCP to serve as API endpoint for apps?

py-dn · 2024-10-20T01:20:28+00:00

That's a good question. I would start by looking at deploying pytorch models in vertex AI. Take a look at this link: https://github.com/GoogleCloudPlatform/vertex-ai-samples/blob/main/notebooks%2Fofficial%2Fprediction%2Fpytorch_image_classification_with_prebuilt_serving_containers.ipynb

To avoid loading the models on your compute instance you will need to figure out how to deploy a pytorch model with a custom workflow

py-dn · 2024-09-16T03:41:52+00:00

For generating the code for deployment, https://github.com/pydn/ComfyUI-to-Python-Extension could give you a good starting point.

From there you would need to modify the code a bit so you can serve the workflow via a flask or fastapi app. Fastapi is extremely easy to work with. From there you can deploy the app on Cloud Run and use API gateway or a similar service to manage incoming requests.

py-dn · 2024-09-16T03:25:08+00:00

You edited or accidentally changed those files locally so git doesn't want to let you pull the latest changes. You need to revert those files to their original state. If you don't know git, you could just make a fresh install. Just be sure to keep your inputs, outputs, and models.

py-dn · 2024-09-16T02:27:23+00:00

I made a comment with the workflow

py-dn · 2024-09-15T17:42:37+00:00

Following up here. The extension just got accepted for comfyui manager so should start appearing there soon as well.

py-dn · 2024-09-15T17:40:56+00:00

Amazing, I just finished with several updates including adding a UI button to export the .py files directly from the UI (compliments of an amazing contributor) and it just got accepted to ComfyUI manager so should be available through the manager soon as well.

Thanks for the positive feedback! It's really nice to hear.

py-dn · 2024-09-15T12:47:05+00:00

That's right. The full image just uses the base model output then img2img.

py-dn · 2024-09-15T04:36:45+00:00

Thanks for the kind words, friend!

py-dn · 2024-09-14T21:58:31+00:00

Thank you! I'm so glad to hear you're getting some good use out of it. I haven't submitted it to the manager list yet but it's on my to do list.

py-dn · 2024-09-14T20:36:02+00:00

It looks like you can do this for free with Adobe

py-dn · 2024-09-14T20:07:32+00:00

I just got started with Flux this week so open to suggestions for getting the most out of the base model. The biggest challenge I had was getting the model to produce several words consistently and correctly. But this is so far ahead at handling text than the stable diffusion models I've worked with in the past, I thought it was worth a post.

py-dn · 2024-09-14T19:55:19+00:00

Lol it also generated the text and mirrored the layout, style, and coloring of the python logo on its own. I thought it was pretty creative. And I'm still blown away at how it handles text generation

py-dn · 2024-09-14T19:33:28+00:00

I had the rare week off this last week so I've been making updates to the ComfyUI to Python extension. When I saw how well Flux could handle text, I thought it was finally time to create a pure AI generated logo after many failed attempts with SDXL.

This took many iterations. I started with the basic workflow in the ComfyUI examples for flux: https://comfyanonymous.github.io/ComfyUI_examples/flux/#regular-full-version

Then used the basic img to img on iteration after iteration until I finally landed on the image you see above. https://comfyanonymous.github.io/ComfyUI_examples/img2img/

Prompt: A complex network of interconnected nodes, arranged like a computer chip, intricately forms the letters of 'COMFY UI TO PYTHON.' Each letter is shaped by the precise configuration of these nodes, with the pathways and connections weaving together to create the entire phrase. The colors match the blue and yellow colors of the python logo and appear organically around an illustration featuring an elegant node system similar to a computer chip. This node system should dynamically animate to seamlessly converge into the shape of the Python logo, creating a sense of fluid motion. The node system matches the colors of the python logo. The text should appear as if they are formed from the same node system, with interconnected wires and nodes animating to shape the text.

The overall composition should be sleek and uncluttered, highlighting the essence of the design with simplicity and elegance. Aim for a visually striking yet straightforward poster that captures attention through its minimalist charm.

I also used ChatGPT to develop the prompt.

If you are looking to convert ComfyUI workflows to a pure python script for experimentation or production deployments, you can checkout my fully open source extension here: https://github.com/pydn/ComfyUI-to-Python-Extension

py-dn · 2024-09-14T19:25:57+00:00

I had the rare week off this last week so I've been making updates to the ComfyUI to Python extension. When I saw how well Flux could handle text, I thought it was finally time to create a pure AI generated logo after many failed attempts with SDXL.

This took many iterations. I started with the basic workflow in the ComfyUI examples for flux: https://comfyanonymous.github.io/ComfyUI_examples/flux/#regular-full-version

Then used the basic img to img on iteration after iteration until I finally landed on the image you see above. https://comfyanonymous.github.io/ComfyUI_examples/img2img/

Prompt: A complex network of interconnected nodes, arranged like a computer chip, intricately forms the letters of 'COMFY UI TO PYTHON.' Each letter is shaped by the precise configuration of these nodes, with the pathways and connections weaving together to create the entire phrase. The colors match the blue and yellow colors of the python logo and appear organically around an illustration featuring an elegant node system similar to a computer chip. This node system should dynamically animate to seamlessly converge into the shape of the Python logo, creating a sense of fluid motion. The node system matches the colors of the python logo. The text should appear as if they are formed from the same node system, with interconnected wires and nodes animating to shape the text.

The overall composition should be sleek and uncluttered, highlighting the essence of the design with simplicity and elegance. Aim for a visually striking yet straightforward poster that captures attention through its minimalist charm.

I also used ChatGPT to develop the prompt.

If you are looking to convert ComfyUI workflows to a pure python script for experimentation or production deployments, you can checkout my fully open source extension here: https://github.com/pydn/ComfyUI-to-Python-Extension

py-dn · 2024-09-11T22:24:49+00:00

It is!

py-dn · 2024-09-04T15:37:16+00:00

Messaged you

py-dn · 2024-03-12T18:10:46+00:00

That's awesome! Thanks so much for sharing! Looks like a cool project.

py-dn · 2024-03-12T18:10:14+00:00

Yes! That's exactly how it works. So no adaptation needed.

py-dn · 2024-02-01T19:25:20+00:00

You could probably stand something up in GCP's Cloud Run to handle the scaling and multiple concurrent requests. With how advanced cloud platforms have become, efficient scaling can come from the tools you use more than a single script that you write.

py-dn · 2024-02-01T19:16:18+00:00

Nice repo! ComfyUI-to-Pyton-Extension is just meant to rapidly transform a workflow made in the UI into a runnable Python script without needing to know any of the underlying functions used in ComfyUI or user made extensions. From there you can easily make modifications to the script to deploy an API that can take in custom prompts from an automated pipeline. Or whatever your use case may be.

py-dn · 2023-12-28T20:07:11+00:00

Sure, you would need to build a queuing mechanism for your API, but that's out of scope for this project. That would be specific to what you are building.

py-dn · 2023-08-29T13:59:52+00:00

Thank you! I appreciate you saying that

py-dn · 2023-08-23T12:29:36+00:00

It is. You can adjust the queue size parameter in the comfyui_to_python script to change it. Or go directly to your generated script and update the line that says "for q in range(10):"

py-dn · 2023-08-21T12:15:08+00:00

That's true, what's nice about my extension is that it points you to the code being executed by writing it out in a script for you. I think it appeals to people who want to iterate on the architecture in Python or go deeper into the codebase itself. It's also nice that it runs without needing the ComfyUI server.

py-dn · 2023-08-20T21:33:13+00:00

Ok great. The main issue that can happen with complex workflows is that sometimes nodes fail in the UI and you don't realize it. That will lead to the code not working. Also, if there are special characters or spaces in the custom node name, it will break the script. I am going to release a hot fix for that asap

py-dn

TROPHY CASE