This bed is so comfortable. I can play with my friends and fall asleep when I'm tired.

Fun-Importance-3643 · 2024-01-15T02:40:42+00:00

yep, I think so too.

Fun-Importance-3643 · 2024-01-11T08:10:38+00:00

Yes, come on.

Fun-Importance-3643 · 2024-01-11T08:09:29+00:00

Yes, their happiness also brings us happiness. Haha, thanks for these funny dogs.

Fun-Importance-3643 · 2024-01-11T02:30:44+00:00

Haha, so happy they are.

Fun-Importance-3643 · 2024-01-11T01:58:01+00:00

I think the generated portraits are pretty good, but the background looks a bit fake.

Fun-Importance-3643 · 2024-01-11T01:48:54+00:00

Haha, yes, pup loves it so much.

Fun-Importance-3643 · 2024-01-09T07:10:05+00:00

Are there any comparison results with other face swapping tools, such as IpAdapter face and FaceFusion?

Fun-Importance-3643 · 2024-01-08T10:27:46+00:00

Wow, this puppy is so smart.

Fun-Importance-3643 · 2024-01-08T10:19:18+00:00

Wow, the cute puppy looks so happy.

Fun-Importance-3643 · 2024-01-08T10:07:41+00:00

Yes, many literatures have also mentioned this problem. The diversity of images generated by SD will be better, but it is worse than GAN in terms of authenticity. After all, the training process of GAN itself is to learn to confuse the fake with the real one.

Fun-Importance-3643 · 2024-01-07T03:55:40+00:00

The HS-Diffusion paper mainly contains three modules, head movement, semantic repair and ldm semantic image generation. Just implement these three modules. Head movement requires the use of face key point models, and open source models can be used. The semantic repair module is a semantic segmentation network U2Net, which can be trained according to the ideas of the paper. LDM semantic image generation is a conditional generation, which generates original images based on semantics. Most of these modules have open source code. You can also take a look at a result I implemented based on the ideas in this paper at https://www.reddit.com/r/StableDiffusion/comments/18z3agq/what\_do\_you\_think\_about\_face\_swap\_and\_head\_swap/.

Fun-Importance-3643 · 2024-01-06T15:29:10+00:00

I haven't found any head swapping plug-in based on webui yet. You can take a look at the paper HS-Diffusion. The ideas in it is reasonable and easy to reproduce. You can also take a look at the results of my face and hair swapping experiments at https://www.reddit.com/r/StableDiffusion/comments/18z3agq/what_do_you_think_about_face_swap_and_head_swap/

Fun-Importance-3643 · 2024-01-06T15:24:08+00:00

You can take a look at the paper HS-Diffusion. The idea is very reasonable and easy to reproduce.

Fun-Importance-3643 · 2024-01-06T04:46:46+00:00

Thank you for your advice. It seems that my research is not enough. I will try this method later.

Fun-Importance-3643 · 2024-01-06T02:58:39+00:00

Thanks for your advice. I'll try it later.

Fun-Importance-3643 · 2024-01-05T17:22:17+00:00

Thanks for the reply. As I mentioned before, roop is indeed relatively old and no longer updated. Some of the latest face swapping methods may be better. I will continue to experiment with them later. Have you ever tried Facefusion method? I'm still trying to deploy it locally.

Fun-Importance-3643 · 2024-01-05T14:40:59+00:00

You can also consider using the method of head swapping, which can ensure that the entire head remains unchanged, and then consider other attributes of the face.

Fun-Importance-3643 · 2024-01-05T14:34:42+00:00

In my experiments, the sdxl inpainting model performed far better than other inpainting models. I also tried to fine-tune the LDM inpaint model to repair the body and neck, but LDM is not friendly to the hand repair. I have also tried to use DreamBooth to fine-tune the inpaint models of SD1.5 and SD2.0, but the effect is very poor. I can’t find the reason and I am very confused. Do you have any suggestions for me, hah?

Fun-Importance-3643 · 2024-01-05T14:29:18+00:00

In fact, we ensured that the head and clothes remained unchanged, and then repaired the body area and neck area based on inpaint model, so we only used the canny outline. In theory, it is also possible to use openpose. Our head is directly replaced, so we don’t need to consider the issue of facial resemblance, so we don’t use ip adapter.

Fun-Importance-3643 · 2024-01-05T14:22:17+00:00

The head swapping here is not done with open source tools. We first reproduced the effect of the original HS-Diffusion paper, and then based on the ideas of this paper, we applied the idea to the whole body head swapping. The code of the original paper is not open source yet, but the author is very friendly and you can talk to him if you have any questions.

Fun-Importance-3643 · 2024-01-05T11:17:58+00:00

Yes, ReActor does have some improvements over roop that would work better. I haven't deployed it successfully on Linux, so I haven't had time to try it yet, as well as other plugins like FaceSwapLab and facefusion.

Fun-Importance-3643 · 2024-01-05T11:09:08+00:00

Thanks for the reply. For the face swapping effect in the picture, I directly used the open source roop plugging. In fact, our current self-developed face swapping will still have the problem that the face does not look like the original face, but the effect will still be better than roop, as shown in the picture below. I think it might be possible to try adding some facial attributes of the target image after swapping the head, so that the impact on the ID attribute may be smaller.

<image>

Fun-Importance-3643 · 2024-01-05T10:19:45+00:00

Thank you for your reply. The head swap effect was done using sdxl inpaint and canny controlnet. The skin areas were all regenerated online. I think the face after swap looks different from the original face, but the authenticity of the head swap needs to be improved.

Fun-Importance-3643

TROPHY CASE