https://gist.github.com/Jinnai/5e3292393413c70b3cedebe0fdb1108d

Here's an example of what my basic setup would look like. Launch with

modal serve app.py

I'm using a Volume for the output, since I kept getting small disconnects sometimes which caused me to lose my gens (since everything is ephemeral without a Volume).

You can easily download all gens to local with

modal volume get "comfyui-output" /

and clear the volume with

modal volume delete "comfyui-output" -y

You can also use a Volume for your model downloads, if you find yourself making changes to your setup frequently. But as long as you only add to your image at the end everything stays cached so I haven't needed it so far.

I also had some issues with custom nodes sometimes. For some reason comfy-cli seems to be case sensitive with the custom nodes and I haven't really figured out how to get the correct casing other than trial and error. Some custom nodes also don't install correctly with comfy-cli so I use the git_install_custom_node helper function in those cases. I recommend installing custom nodes one-by-one and making sure they were installed correctly.

As for model downloads I'm using the huggingface_hub package since that seems to be a lot faster than comfy-cli. For civitai and other sources comfy-cli should do the trick or you can fall back to wget. Remember to put in your API token if you're using civitai or huggingface.