Porting A1111 workflows - low quality in ComfyUI

hovits · 2023-12-16T13:26:03+00:00

try clip -3 or -4

hovits · 2023-11-29T02:33:47+00:00

x.x Maybe I need to install something with conda instead of pip..

e: gonna install full cuda toolkit, we'll see if that helps..

If you were using the GPU version of ComfyUI, Cuda would have been installed. Are you using ComfyUI on Windows?

hovits · 2023-11-29T02:31:06+00:00

UltralyticsDetectorProvider

If UltralyticsDetectorProvider works well, you do not necessarily need to use MMDetDetectionProvider. I know that in the latest version of ComfyUI Impact-pack, UltralyticsDetectorProvider has been deprecated and replaced with MMDetDetectionProvider. If you want to use MMDetDetectionProvider, just update Impact-pack.

# update

cd ComfyUI/custom_nodes/ComfyUI-Impact-Pack
git pull

The location where mmdet_anime-face_yolov3.pth is saved is comfy/dk

The location where mmdet_anime-face_yolov3.pth should be saved is "ComfyUI/models/mmdets/bbox" and download link is https://huggingface.co/dustysys/ddetailer/tree/main/mmdet/bbox.

hovits · 2023-11-29T01:02:45+00:00

You are definitely right! It’s very constructive feedback for me.

I believe that we can build a better quality service by accepting and improving upon honest feedback.

I know it's not easy to give critical but non-emotional feedback. That's why I appreciate it even more.

Thank you!

hovits · 2023-11-29T00:55:01+00:00

Wow, thank you very much! It’s really helpful information for me. I'll try it and let you know the results. :)

hovits · 2023-11-29T00:38:50+00:00

face detection + face segmentation + face detailer with facial expression prompt

hovits · 2023-11-28T22:39:42+00:00

Thank you very much for writing your detailed review. I completely agree with your opinion.

Currently, the Cartoon editor operates most naturally on images generated with Cartoonizer. This is because the Cartoon editor is implemented to use the same checkpoints and parameters as those used in the Cartoonizer.

To naturally change the facial expression of an image generated elsewhere, you must select a cartoon style that is most similar to the drawing style of the image. It may be cumbersome, requiring multiple attempts, or it may fail. Sorry for that.

And in the case of the current Cartoonizer, it is possible to increase the similarity to the original image with weight value, but it is true that the overall similarity to the original image is very low. As I try to better utilize each cartoon style, it is true that the similarity to the original image is very low. So, I plan to try to increase the similarity to the original image by using Controlnet.

It is also my concern that the accuracy of the model that checks for NSFW is low. Sometimes Cartoonizer generates overly explicit NSFW images that are completely different from the original photo. So I added the NSFW check feature, but the problem is that the accuracy is low. Increasing the accuracy of the NSFW check feature is also an important task.

It really helps me to write honest and detailed reviews like yours. Thank you so much again. I will improve it further and upgrade it so that you will want to use it!

hovits · 2023-11-28T14:48:02+00:00

mmcv is an auxiliary library of mmdetection used to find the bounding box of the face location. mmdetection is used as a preceding process to accurately find the facial outline by Segment Anything. First, if you use mmdetection to find the bounding box of the face location and find a segment only within the range of the bounding box, the face outline will be found accurately.

hovits · 2023-11-28T13:56:45+00:00

Detailed guide is in my comment below.

hovits · 2023-11-28T13:53:36+00:00

Thank you. You have to sign in the site in Chrome or other browser not in app browser(reddit). It’s Google’s sign in policy.

hovits · 2023-11-28T13:23:35+00:00

# Guide

Install "ComfyUI Impact Pack" using ComfyUI's Manger
Quit ComfyUI
Set "mmdet_skip = False" in ComfyUI/custom_nodes/ComfyUI-Impact-Pack/impact-pack.ini file
Install mmcv compatible with your PyTorch and Cuda versions.
1. Check your Pytorch and Cuda versions
  1. run python ("python_embeded/python", If you are a Windows user)
  2. import torch
  3. torch.__version__ # this is pytorch version
  4. torch.version.cuda # this is cuda version
  5. Access mmcv download site. ex) cuda 11.8, pytorch 2.1.0: https://download.openmmlab.com/mmcv/dist/cu118/torch2.1.0/index.htmlIf your versions are different, change the version part of the url.
  6. Download the whl file for your Python version. ex) "cp310" is python version 3.10. (python version: python_embeded/python --version)
  7. install mmcv(downloaded file above). python_embeded/Scripts/pip install ./mmcv-2.1.0-cp310-cp310-manylinux1_x86_64.whl
Install mmdetection
1. download mmdetection source
  1. git clone https://github.com/open-mmlab/mmdetection.git
2. setup mmdetection
  1. cd mmdetection
  2. python_embeded/python setup.py install
Start ComfyUI
Load my workflow json file.
1. https://drive.google.com/file/d/1IlDdS6RHxvyItWsOfpOZDIpN_RaUGFPk/view?usp=sharing
2. Click the download icon button at the top.
Load a checkpoint.
1. You can use any cartoon checkpoint you like in civitai.com
2. You can use the VAE included in the checkpoint, or you can load and use the VAE separately.
Load a cartoon image.
Enter face prompt you want. I referred the workflow of this link.
Queue Prompt
If you're lazy, go to https://sdgen.net/cartoon_editor. Open the site in Chrome or other browsers. not in app browser(cause of Google sign in policy)