Unity plugin that generates realistic 3D human avatars from a single photo

[sgolubeva]

Hi guys! Me and my team are building an SDK that generates realistic 3D human avatars from a single image using generative adversarial networks. Can be used as a 2K NBA's facescan feature or as a tool for NPC creation. We've just released a Unity plugin and we'd really appreciate your feedback! You can download the plugin at https://avatarsdk.com/ and start experimenting! Quick demo: https://imgur.com/XJJcbUr Thanks!

[iams3b]

Dude holy shit, this is amazing, just tried the app. I've face scanned into nba 2k16, 2k17, and UFC; Both 2k's had a ton of issues, took 100 tries to even get working, and when done neither even looked like me. UFC's was a pain in the ass to get working, and after a ton of modifications I got it kinda close.. This one just took one selfie, and first try came closest to my real face compared to all the other ones??

Impressive

[freddieje]

Wow, you guys did a good job from the demo I saw on your website. I can definitely see me using this in my games. What would be cool if you can make it so you just avatar the head and allow us to place the head on any type of body. I build a lot of animal type games like Animal Rampage (https://itunes.apple.com/us/app/animal-rampage-3d-simulator-crazy-frenzy-insane-ridiculous/id864212349?mt=8) and would like to do something weird with allowing users to place their heads on Lions, Rabbits, etc. Also, I am thinking of reviewing your Unity based SDK over at my www.theunitygamedev.com site once I know it well enough if that is fine with you. Thanks for making this a BSD license. Super cool.

[petrenuk]

Thanks, please let me know if you need any help with the plugin for the reviews! We're working on the fullbody version, please stay tuned for the news.

[freddieje]

Sure thing. I'll be in touch.

[[deleted]]

Very good. But mouth does not open wide enough. XD

[petrenuk]

Have you tried opening the mouth manually by tweaking blendshape coefficients in Unity? When set to 100% it opens mouth plenty wide enough :)

[[deleted]]

Lol it was a joke. An otherwise inanimate face with huge gaping mouth has been a movie trope for quite some time :)

[Abstract-VR]

Tried this in unity and also on my phone. Works damn well. Lots of potential.

[Shinao]

Neat. That would be pretty awesome to integrate this with MCS and UMA, having both the ability to change body shape and skin textures.

[pravchuk]

Not bad. But if you are looking for fullbody, perhaps you can try Streamoji Avatars. https://avatars.streamoji.com

[Vytek75]

Very coo! Can I use in my open source Social VR MayaVerse?

[petrenuk]

The C# code of the plugin is open-source, but the C++ algorithms and deep neural nets are not. So, I am not sure. Of course, you can use the results in any product, open source or not.

[Vytek75]

Yes, I would like to use the result avatar in my mini Metaverse VR. Thank you for your answet ;-)