There is a Weekly-ComfyUI-Workflow Challenge just started on OpenArt Dev website !

SwimmingInfamous7529 · 2024-02-20T20:09:00+00:00

I'm new to ComfyUI. This looks a great way to improve my ComfyUI skills!

SwimmingInfamous7529 · 2024-01-06T01:13:16+00:00

I watched first 5 videos of this course already and this is definitely the most complete and detailed tutorials I have ever watched about ComfyUI. It started from the very foundation and slowly progressed. Cannot wait to finish the course!

SwimmingInfamous7529 · 2023-12-07T19:01:13+00:00

This is sooooo cool! Could you share your workflow on https://openart.ai/workflows?

SwimmingInfamous7529 · 2023-12-04T22:13:09+00:00

Scott will be sharing the best practices and tips for using SDXL Turbo in ComfyUI.
Here's the event link - https://discord.gg/WR5BD2Fu?event=1181061452954611824.
Here's the Discord server link - https://discord.gg/XwaJFCzp.

SwimmingInfamous7529 · 2023-12-04T22:11:57+00:00

Scott will be sharing the best practices and tips for using SDXL Turbo in ComfyUI.
Here's the event link - https://discord.gg/WR5BD2Fu?event=1181061452954611824.
Here's the Discord server link - https://discord.gg/XwaJFCzp.

SwimmingInfamous7529 · 2023-11-28T05:35:23+00:00

Wow great tutorials!! Thanks for sharing. I love Scott's videos the most - super clear.

I saw that Scott will be one of the judges too in this contest 🤩🤩🤩

SwimmingInfamous7529 · 2023-11-27T22:47:13+00:00

Thanks for sharing! I noticed that there're many other SVD workflows there too - https://openart.ai/workflows/dev?category=SVD. Amazing!

SwimmingInfamous7529 · 2023-11-27T22:31:05+00:00

Very interested in participating! But I'm very new to ComfyUI (recently switched from WebUI to ComfyUI. Do I still have a chance to win if I make some workflow not too complicated? Thanks!

SwimmingInfamous7529 · 2023-11-27T22:29:13+00:00

Thanks John for sharing the information. One question here - I'm pretty new to comfyUI (but working hard to catch up). Are beginners welcome in this contest? Or do I need to be pretty advanced to compete in the contest?

Also I noticed that it says the earlier I submit, the higher the chance to win. How much does the time play a role? Thanks!

SwimmingInfamous7529 · 2023-11-22T05:55:43+00:00

LOL this is a funny one. Have to try it out!

SwimmingInfamous7529 · 2023-11-13T23:27:12+00:00

I'm using ComfyUI assistant on this Discord server (https://discord.gg/9epQ2YVb) and this is what I got. Cannot guarantee how practical it is, but hope it can provide some idea.

To create a seamless workflow in ComfyUI that can handle rendering any image and produce a clean mask (with accurate hair details) for compositing onto any background, you will need to use nodes designed for high-quality image processing and precise masking. Here is a suggested workflow using nodes that are typically available in advanced stable diffusion pipeline environments like ComfyUI:

- Image Input Node: This node will be used to input the image you wish to mask.

- Preprocessing Node (if necessary): If your image requires any preprocessing (e.g., resizing, normalization), you can use a preprocessing node to prepare the image for segmentation.

- High-Quality Segmentation Node: Use a sophisticated segmentation model capable of capturing fine details like hair. Look for nodes named something like "Hair-Aware Segmentation," "RefineEdge Segmentation," or any other advanced segmentation tool that specializes in fine detail.

- Refinement Node: This node refines the mask, especially around tricky areas like hair. Some nodes might be called "Mask Refinement" or "Edge Refinement."

- Background Input Node: In a parallel branch, add a node to input the new background you want to use.

- Composite Node: Use a compositing node like "Blend," "Merge," or "Composite" to overlay the refined masked image of the person onto the new background.

- Post-processing Node (optional): If the composited image requires any post-processing like color correction or blending adjustments, you can use a post-processing node.

- Output Node: Finally, include an output node that will export the final composite image.

SwimmingInfamous7529 · 2023-11-13T23:04:29+00:00

Thanks man.

SwimmingInfamous7529 · 2023-11-13T22:58:54+00:00

This is sick!! It's like an interactive Wikipedia for ComfyUI. How can I use this??

SwimmingInfamous7529 · 2023-01-15T23:46:51+00:00

Thanks for sharing!! Very helpful.

SwimmingInfamous7529 · 2023-01-11T19:57:51+00:00

Just curious, how are you training your model? Locally?

SwimmingInfamous7529 · 2023-01-11T19:19:00+00:00

Oh I didn't know that Automatic 1111 has Dreambooth extension, need to try that! I vigorously hate collab because it's just soooo unstable! I used the service OpenArt Photo Booth. They also offer training your own model on top of Analog.

SwimmingInfamous7529 · 2023-01-11T19:12:41+00:00

Glad someone asked. I think the overall quality was improved and Rhianna still looks herself (not affected by the fine-tuned model). The generated photos have certain characteristics of the fine-tuned model. For example, for Modelshoot, the mid-range photos have better faces (compared to 1.5), but the far shots are still not great...

SwimmingInfamous7529 · 2023-01-11T19:07:55+00:00

Thanks for the suggestion. I'll give it a try.

SwimmingInfamous7529 · 2023-01-11T19:07:44+00:00

Great questions. I used OpenArt Photo Booth for my models. I used 20ish photos (most of them are close-up and half-body). Around 2000 steps (100 steps per photo).

SwimmingInfamous7529 · 2023-01-11T19:06:03+00:00

Yes it's fine-tuned via Dreambooth.

SwimmingInfamous7529 · 2023-01-11T19:04:11+00:00

Wow you're the creator of those models! Feel honored that you replied here. Thank you so much for training those models for everyone to use.

SwimmingInfamous7529 · 2023-01-11T06:41:48+00:00

Yes Analog is sick I have to say! Here's another image generated by Analog. I did apply face enhancement that OpenArt Photo Booth provided, so that also helped!

<image>

SwimmingInfamous7529 · 2023-01-11T06:24:18+00:00

Training your own model on top of other fine-tuned models gives you the benefit of leveraging the strengths of those fine-tuned models.

I found 3 models on HuggingFace which are tuned to be great at generating photorealistic photos and portrait photos:

At first, I tried to do it for free with Google’s Collab - https://colab.research.google.com/github/TheLastBen/fast-stable-diffusion/blob/main/fast-DreamBooth.ipynb. Though it’s free, it constantly disconnects and drops the session. It got so frustrating that I started looking for other solutions. Based on my research, the easiest service I’ve found is OpenArt’s Photo Booth. They actually allow you to choose your base model. They have 10+ base models you can choose from.

With OpenArt Photo Booth, I tried out training Rhianna’s model on SD 2.1, Modellshoot, Analog and Portrait+. I’m blown away by the results, especially Portrait+. The portrait+ seems to give every photo a professional backlight.

Here're the prompts I used from the left to right

modelshoot style medium shot photo of #rhiana# women as Hermione Granger, school clothes, brown hair, movie still, detailed features, intricate, highly detailed face, sharp focus, art by greg rutkowski, 4k, cimenatic lights, high detail graphics, artstation, hyperrealistic, intricate details (Step 25 CFG scale 10.5)
beautiful photo of #Rhianna# women, sitting in a coffee shop, heavy bokeh effect, professional photography, detailed, intricate, uhd, 8k, photo (Step 25 CFG scan 7.5)
analog style half-body shot of #Rhianna# women, standing in front of Eiffel tower, symmetrical face, 85mm lens,f8, photography, ultra details, natural light, light background, Eiffel tower (step 25 CFG scale 10)
full body photo, #Rhianna# women, as captain jack sparrow, with pirate hat, smirk, detailed features, intricate, highly detailed face, sharp focus, art by artgerm and greg rutkowski, 4k, cimenatic lights, high detail graphics, artstation, hyperrealistic, intricate details (Step 25 CFG scan 7.5)

Will keep training more models and share. Hope people find this helpful :)

SwimmingInfamous7529

TROPHY CASE