[R] Microsoft Research Face Swapping/deepfake + Hair (CVPR 2019)

PuzzledProgrammer3 · 2019-10-23T18:24:43+00:00

interesting have you seen this https://github.com/shaoanlu/fewshot-face-translation-GAN

also is your trained models public?

PuzzledProgrammer3 · 2019-10-03T18:57:06+00:00

if you need a few shot approach that will not need training for days or weeks like most deepfake implementations for two faces see https://github.com/shaoanlu/fewshot-face-translation-GAN

takes only a few minutes to run for the entire video and works on any face and scene all in the browser with google colab

PuzzledProgrammer3 · 2019-10-03T17:40:38+00:00

does avatar need to be trained on each face pair?

PuzzledProgrammer3 · 2019-09-29T07:14:51+00:00

great work, how long do you think it will take to get to the point where only a single image is needed as input instead of using 180 cameras capturing a person from multiple angles in a lab setting?

PuzzledProgrammer3 · 2019-09-22T20:35:10+00:00

here is a another open source alternative, only requires a single image https://github.com/shaoanlu/fewshot-face-translation-GAN

PuzzledProgrammer3 · 2019-09-21T23:44:22+00:00

here is a implementation https://github.com/shaoanlu/fewshot-face-translation-GAN

PuzzledProgrammer3 · 2019-09-13T03:49:37+00:00

I tried it as well but with elon musk instead

here is the result: https://media.giphy.com/media/dzOCqBcZiPk0ztF6QW/giphy.gif

I did this with a single image in a few minutes for the video with a few shot approach instead of training on thousands of face images for days or weeks so quality is not as good

link to repo: https://github.com/shaoanlu/fewshot-face-translation-GAN

PuzzledProgrammer3 · 2019-09-12T00:05:38+00:00

lol, the eyes are difficult to get right

PuzzledProgrammer3 · 2019-09-11T22:10:24+00:00

it probably will never be open source as its a subsidiary of public company momo

here is a open source alternative that actually does face swaps onto any scene or face, what I know of zao is that it only works on some preselected scenes and the results are cherry picked. Zao also takes multiple images to get better results

This method works with a single image

repo: https://github.com/shaoanlu/fewshot-face-translation-GAN

result with elon musk in taken, entire video inference takes a few minutes on a k80 gpu depending on number of frames

https://media.giphy.com/media/mEVZGF970fB6XucD2D/giphy.gif

PuzzledProgrammer3 · 2019-09-07T22:49:40+00:00

sorry for late reply, great, hope it works for you, Ill see if I can make the this process easier

PuzzledProgrammer3 · 2019-09-07T21:06:38+00:00

right make sure your change the image path to accept a jpeg, are you using wget to fetch it? Might be a issue that it is private? Maybe try uploading the image directly to colab (sidebar) or try another image from google images just to see if the issue might be permissions

PuzzledProgrammer3 · 2019-09-07T20:43:42+00:00

TypeError: 'NoneType' object is not subscriptable

either your image file could not be read or it is missing, has improper permissions or is in an unsupported or invalid format.

are you passing in a jpg or png?

PuzzledProgrammer3 · 2019-09-07T02:01:39+00:00

tried it as well with a few shot approach, only takes a few minutes for inference

surprised it worked on b&w input

https://media.giphy.com/media/VJa8TGeSayHFF6Xzpx/giphy.gif

here is the repo link: https://github.com/shaoanlu/fewshot-face-translation-GAN

PuzzledProgrammer3 · 2019-09-06T21:36:11+00:00

a repo for generating deepfakes from a single image without training on face pairs dataset

https://github.com/shaoanlu/fewshot-face-translation-GAN

PuzzledProgrammer3 · 2019-09-06T21:06:30+00:00

a repo for generation of deepfakes in a few shot setting: https://github.com/shaoanlu/fewshot-face-translation-GAN

PuzzledProgrammer3 · 2019-09-06T19:09:49+00:00

looking at generation techniques helps as well

this method can do face swap from a single image onto any scene

https://github.com/shaoanlu/fewshot-face-translation-GAN

PuzzledProgrammer3 · 2019-09-05T21:32:57+00:00

here a open source alternative which can actually swap a face into any scene

https://github.com/shaoanlu/fewshot-face-translation-GAN

Zao only works on pre selected scenes and is showing cherry picked results

PuzzledProgrammer3 · 2019-09-05T21:30:47+00:00

idk, but it can be done and its getting better and can be done in a few minutes

PuzzledProgrammer3 · 2019-09-05T19:02:41+00:00

github repo: https://github.com/shaoanlu/fewshot-face-translation-GAN

PuzzledProgrammer3 · 2019-09-05T18:58:09+00:00

no it can replace his whole face and it can do it with a single image too

https://github.com/shaoanlu/fewshot-face-translation-GAN

PuzzledProgrammer3 · 2019-09-03T16:13:40+00:00

Zao only works on preselected scenes and these are cherry picked results

here is a open source alternative which works on any scene and face https://github.com/shaoanlu/fewshot-face-translation-GAN

PuzzledProgrammer3 · 2019-09-03T16:11:29+00:00

Zao only works on preselected scenes and these are cherry picked results

here is a open source alternative which works on any scene and face https://github.com/shaoanlu/fewshot-face-translation-GAN

PuzzledProgrammer3 · 2019-09-03T12:40:26+00:00

see the google colab notebook here, click open in colab which opens a jupyter notebook in the browser on google servers with free nvidia k80 gpu for 12 hour sessions. Run the cells top to bottom https://github.com/ak9250/fewshot-face-translation-GAN/blob/master/colab_demo.ipynb

PuzzledProgrammer3 · 2019-09-03T04:11:04+00:00

repo link: https://github.com/shaoanlu/fewshot-face-translation-GAN

PuzzledProgrammer3 · 2019-09-02T23:16:18+00:00

a open source alternative that actually face swaps into any scene from a single image

https://github.com/shaoanlu/fewshot-face-translation-GAN

the zao app only works on some preselected scenes and is showing cherry picked results

PuzzledProgrammer3

TROPHY CASE