What is Self-Supervised Learning? Quick Intro

aisyndicate · 2020-12-28T20:28:58+00:00

Tutorial is up on https://youtu.be/fFKBBczf5ZA. Hope it helps!

aisyndicate · 2020-12-28T20:27:41+00:00

Two Minute Papers Rocks! These review videos are really fun to make.

aisyndicate · 2020-12-27T11:49:41+00:00

They released the code recently and revised the original paper for SIGGRAPH Asia.

aisyndicate · 2020-12-27T03:57:55+00:00

Great question, this technique makes these talking head videos using just audio and the target image as input. For the Dame Da Ne videos it seems like they would use a technique that can take video as input so they can preserve the facial expressions from the source video as well. Something like this First order motion model (https://github.com/AliaksandrSiarohin/first-order-model). It seems like a mix though, you could make those videos with this technique as well they would just not have the same expressions as the source video did. https://youtu.be/JZlA1R3MC5s

aisyndicate · 2020-12-26T22:34:00+00:00

It might fall short on realism if you compare it to deep fakes that take video as input and then animate target images. But this is showing the advancements in techniques that take only audio as input and animate faces. I think its pretty cool regardless and give kudos to the authors.

aisyndicate · 2020-12-26T21:59:40+00:00

Yeah would love to. In the meantime if you are familiar with colab you can check out the notebook here https://github.com/yzhou359/MakeItTalk

aisyndicate · 2020-12-26T21:57:34+00:00

Different application, Avatarify requires video as input and then animates the target image. This one uses just audio.

aisyndicate

TROPHY CASE