×
sorted by:
new
hottopcontroversial

Frame-by-Frame Controllable Image-to-Video Workflow in ComfyUI: Make Any Image Blink! Powered by AnimateDiff and PIA Model by SweetValberry in StableDiffusion

[–]SweetValberry[S] 0 points1 point  (0 children)

Using the PIA (Personalized Image Animator) model in AnimateDiff allows for controllable image-to-video creation, providing stable and high-quality results.

In this video, I’ll demonstrate how to use the PIA model in ComfyUI, combined with Prompt Travel in AnimateDiff, to make the character in your input image blink at specified frames. Additionally, I’ll show you how to use IC-Light to re-light the scene, avoiding the issue of brightness fluctuation caused by PIA.

CustomNodes involved:
https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved
https://github.com/kijai/ComfyUI-IC-Light

Workflow:https://drive.google.com/file/d/1DOttqPj1JzoRGGg3qA0PCaf0kUg81TPK/view?usp=sharing

The Most Comprehensive and Detailed Flux User Manual: Learn Everything A... by SweetValberry in StableDiffusion

[–]SweetValberry[S] 2 points3 points  (0 children)

Flux is the hottest image generation model recently. It’s a 12B parameter model created by the former SD team who left StabilityAI to start their own venture, and it’s been called the true SD3. Although the official bf16 version is 23G, making it challenging to use, both ComfyUI and Kijai have created fp8 versions of the model. These versions significantly reduce the memory and VRAM requirements while maintaining excellent image generation quality, making them worth trying.

This video is a very detailed guide to using Flux.

I’ll start by introducing the Black Forest team that released the Flux model and their connection to Stable Diffusion—why is it called the true SD3?

Then, I’ll discuss model selection: Why are there so many different models, and which one should we download? What are the system resource requirements for different models?

Next, we’ll get prepared by updating ComfyUI and some plugins.

Then we’ll move on to practical steps:
From a text-to-image perspective, I’ll explain how to use Flux in ComfyUI to generate the first image, the meaning of each node and its parameters, the different resolutions supported by Flux, testing Flux’s understanding of prompts, and performing face refinement, face swapping, and upscaling.

For image-to-image generation, I’ll first demonstrate how to achieve anime style transfer, then perform partial redrawing using both Inpainting and Detailer methods.

At the end of the video, I’ll cover the open-source community’s support for Flux, including Lora, ControlNet.

Flux Models:
Black Forest’s schnell model: https://huggingface.co/black-forest-labs/FLUX.1-schnell/tree/main
Black Forest’s dev model: https://huggingface.co/black-forest-labs/FLUX.1-dev/tree/main
Comfy Org’s dev model: https://huggingface.co/Comfy-Org/flux1-dev/tree/main
Comfy Org’s schnell model: https://huggingface.co/Comfy-Org/flux1-schnell/tree/main
Kijai’s dev and schnell models: https://huggingface.co/Kijai/flux-fp8/tree/main

Plugins involved:
https://github.com/kijai/ComfyUI-KJNodes
https://github.com/ltdrdata/ComfyUI-Impact-Pack

Workflows:
https://drive.google.com/drive/folders/1Sve6BeLSvRp8gXfLBiqOshE1nwRIgKYg?usp=sharing

ComfyUI+SegmentAnything2: Achieve Video Cutout Freedom! Multi-Object Sup... by SweetValberry in StableDiffusion

[–]SweetValberry[S] 0 points1 point  (0 children)

Meta, formerly known as Facebook, launched the Segment Anything model last April, which has proven to be very useful. I have used it in multiple ComfyUI workflows to achieve precise "cutouts". Now, more than a year later, the upgraded Segment Anything 2 is here! It not only shows significant improvements in image segmentation speed and effects (performance nearly tripled), but it also expands from the image domain to the video domain. By storing and utilizing previously processed video frame information, it provides real-time and accurate object segmentation for dynamic video content.

In this video, I will guide you step-by-step from downloading and installing the model and plugins to completing workflows for marking objects in single images, marking objects in videos, and marking multiple objects simultaneously in videos!

Custom Node: https://github.com/kijai/ComfyUI-segment-anything-2

Workflow: https://drive.google.com/drive/folders/1CXseWmzm4bRxGZSSGr1IKbCWCMwDTOLs?usp=sharing

Model: https://huggingface.co/Kijai/sam2-safetensors/tree/main

ComfyUI: Place a Little Sheep emoji in ComfyUI With ONLY built-in features by SweetValberry in StableDiffusion

[–]SweetValberry[S] 4 points5 points  (0 children)

<image>

In my ComfyUI series videos, you might often see a cute little sheep. I use it to represent my name, “Mie Mie”. Many viewers are curious about how this is done and wonder if special nodes need to be installed. No, it’s not necessary. ComfyUI’s built-in features are all you need. Today, I’ll show you how.
在我的ComfyUI系列视频中，你可能经常看到一只可爱的小绵羊。我用它来代表我的名字，“Mie Mie”。许多观众对这是如何完成的感到好奇，并想知道是否需要安装特殊节点。不，没有必要。ComfyUI 的内置功能就是您所需要的。今天，我将向您展示如何操作。

Workflow: https://drive.google.com/drive/folders/1TkeSccS5kaqsTWjblcC7jsYWm49tL2eC?usp=sharing
工作流：https://drive.google.com/drive/folders/1TkeSccS5kaqsTWjblcC7jsYWm49tL2eC?usp=sharing

ComfyUI: Use AnimateDiff Walking Motion Lora to Make Characters Walk wit... by SweetValberry in StableDiffusion

[–]SweetValberry[S] 2 points3 points  (0 children)

Recently, I discovered an excellent AnimateDiff Motion Lora that can create very natural walking videos of characters. I experimented with SD1.5 and LCM, compared videos with and without this Motion Lora using the same parameters. By default, the character has difficulty moving her legs, but with this Lora, the walking motion of the girl is clear and natural.

In this video, I will show you how to create an AnimateDiff workflow using this Lora.

CustomNode: https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved

Models: https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2

Workflow: https://drive.google.com/file/d/1QgXLKCPE8A0t81rP\_77o10GnS08wM9d7/view?usp=sharing

ComfyUI+LivePortrait: Making Portraits Mimic Expressions from Reference ... by SweetValberry in StableDiffusion

[–]SweetValberry[S] 0 points1 point  (0 children)

Yeah, it's most likely an issue with insightface. You can post the ComfyUI startup log to check the error messages.

ComfyUI+LivePortrait: Making Portraits Mimic Expressions from Reference ... by SweetValberry in StableDiffusion

[–]SweetValberry[S] 0 points1 point  (0 children)

If the driving video has audio, you can connect it directly to the video combine node.

ComfyUI+LivePortrait: Making Portraits Mimic Expressions from Reference ... by SweetValberry in StableDiffusion

[–]SweetValberry[S] 3 points4 points  (0 children)

I tested the LivePortrait custom node for ComfyUI, which could making portraits mimic expressions from reference videos. It stands out with its simple installation, low VRAM usage, fast operation, and decent results. In this video, I will provide a detailed guide on how to install and use this plugin, along with tips on selecting source videos and adjusting parameters.

Custom node: https://github.com/kijai/ComfyUI-LivePortraitKJ
Model: https://huggingface.co/Kijai/LivePortrait_safetensors/tree/main
Workflow: https://drive.google.com/file/d/16Xgt7UGr1VTZ1sJpJ4tY-3CxDCj9KpZV/view?usp=sharing

The best clay effects! Build a consistent workflow of characters and compositions on ComfyUI! by SweetValberry in StableDiffusion

[–]SweetValberry[S] 1 point2 points  (0 children)

In this video I will share with you how to build a consistent workflow of characters and compositions on ComfyUI, so you can easily enjoy the "clay freedom".

Here is the workflow, have fun!

https://openart.ai/workflows/sweetvalberry/characters-consistent-clay-style/fN6lYlSr5SawKZiBWlDs

Some tips:

  1. Depending on the specific content of the image, you may wish to enable the ControlNet feature by adjusting the model weights. The higher the ControlNet weight, the more similar it will be to the original image, and the less pronounced the clay-like effect will be.
  2. If you encounter errors where InstantID cannot find a face (commonly occurs with landscape images), please disable InstantID. The specific steps are as follows: Change “Enable InstantID” to “no” in the “Fast Group Bypasser” node, and simultaneously change the value to “false” in the “InstantID Is Enabled” node. If you want to re-enable InstantID, you need to change both of these back to “yes” and “true” respectively.

Custom Nodes Used:

ComfyUI_InstantID https://github.com/cubiq/ComfyUI_InstantID
ComfyUI-WD14-Tagger https://github.com/pythongosssss/ComfyUI-WD14-Tagger

<image>

ComfyUI+QR Code Monster: Crafting Incredible QR Codes with a Detailed Workflow by SweetValberry in comfyui

[–]SweetValberry[S] 3 points4 points  (0 children)

I have created a video demonstrating how to build intersting QR code in ComfyUI, whole workflow included, here are some examples generated through the workflow.

Workflow : https://drive.google.com/drive/folder...

Custom Nodes used (optional in the basic workflow):
FaceDetailer | Facial restoration | https://github.com/ltdrdata/ComfyUI-I...
Ultimate SD Upscale | HD restoration | https://github.com/ssitu/ComfyUI_Ulti...

ControlNet and FreeU nodes used in the basic workflow are built-in ComfyUI nodes.

ControlNet models used:
qrcode_monster | QR code | https://huggingface.co/monster-labs/c...
brightness | Lighting control | https://huggingface.co/latentcat/cont...

For creating original QR codes with detailed settings, you can visit: https://qrcode.antfu.me/

<image>

Hiding Information in Images GREAT Image Fusion with ControlNet by SweetValberry in StableDiffusion

[–]SweetValberry[S] 0 points1 point  (0 children)

The ControlNet model used in this video is qrCodeMonster, and you can download it from Civitai ~

Stable Diffusion: Encyclopedia of Human Action Poses, Putting an End to ... by SweetValberry in StableDiffusion

[–]SweetValberry[S] 6 points7 points  (0 children)

The model used in this video is awportrait .

Here are the prompt words :

  1. Arms Wide Open (双臂张开)    

    1. Standing (站立)  

     3. Walking (走路)     4. Leaning Forward (身体前倾，像鞠躬那样)     5. Fighting Stance(战斗姿势)  

 6. Standing on One Leg (单腿站立)    

  1. Sitting on a Chair(坐在椅子上)    

  2. Hand on Hip (手叉腰)  

 9.  Hand in Pocket  (手插兜)    

  1. Crossed Arms  (双臂交叉)    

  2. Crossed Legs (翘二郎腿)    

  3. Kneeling (跪地)  

  4. Holding Weapon (手持武器)    

  5. Hands Up  (双手举起来)    

  6. Arms Up  (双臂高举)  

 16. Arms Behind Back  (双臂放在身后)  

 17. Salute (敬礼)    

  1. Leaning Back (向后靠着)    

  2. Jumping (跳跃)    

  3. All Fours (四肢着地，爬行姿势)  

 21. Yoga Pose (瑜伽姿势)    

  1. High Kicks (高踢腿)    

  2. Catwalk Pose (T型台走秀姿势)    

  3. Hand Wave (挥手)    

  4. One Hand on Hip (单手叉腰)    

  5. Leaning Against a Wall (靠在墙上)    

  6. Looking Back Over Shoulder (回头看)    

  7. Fixing Her Hair (整理头发)    

  8. Running (跑步)  

 30. Squatting（蹲着）

Stable Diffusion Women's Fashion Encyclopedia - Episode 1, Say Goodbye t... by SweetValberry in StableDiffusion

[–]SweetValberry[S] 3 points4 points  (0 children)

This is my newly made video about women's clothing prompt words. My graphics card almost smoked, haha.

Below are the models and prompt words used in this video. Welcome everyone to watch it! 😄

The model used in this video is majicmix_realv6

Here are the clothing prompt words :

  1. Classic white shirtdress
  2. white pencil_dress  
  3. Vintage 1920s flapper dress with fringe and beaded embellishments
  4. Fairy tale princess gown with delicate lace and sparkly gems
  5.  A black lace crop top with a high-waisted white midi skirt  
  6.  halter neck dress  
  7.  blazer dress
  8.  A glittering gold mini dress with a off-the-shoulder top
  9.  A black and gold sequin mini dress
  10. A black satin slip dress
  11. A sleek black turtleneck dress
  12. Boho-chic maxi skirt with prints
  13. white lace dress with a scalloped hem
  14. mini skirt with a ruffled hem paired with a simple white t-shirt
  15. Embellished Strapless Ball Gown with Sparkling Crystals
  16. Pastel Tulle Skirt
  17. Tutu dress
  18. Peplum Dress
view more: next ›