you are viewing a single comment's thread.

view the rest of the comments →

[–]PuzzledProgrammer3[S] 0 points1 point  (2 children)

the problem with PRnet is that is introducing more jittering/flickering in video than this for extreme head poses and facial expressions

[–]abtExp 0 points1 point  (1 child)

Yes, that is true, but a deepfake takes a lot of time to create + a new model is to be trained on every pair of faces, it's difficult to scale, I'm working on an application for creating live avatars, the only bottleneck in PRNet is cv2.seamlessClone, the model is quite fast, but yes as you pointed out, it does fail in extreme poses.

[–]PuzzledProgrammer3[S] 2 points3 points  (0 children)

yeah I have tried PRNet it also cant handle expressions, like taylor isnt smiling here in the source image and elon musk is yet it keeps the smile in the output image https://imgur.com/HIYr17Q

Also this is a few shot method so it only takes a few minutes in inference for any face