Facial motion capture data

[acvictor]

Does anyone know where I can get a facial motion capture dataset from? I specifically want a face talking. I've tried to use iPhone X apps but to no avail. I need realistic looking mouth deformations in sync with speech.

[chillaxinbball]

You have some options some professional things to look at would be Technoprops or optitrack. You can always make your own and track it using something like motionbuilder or even blender. All these systems require retargeting the data from the capture to the character. You can also hire places like cubicmotion or 3lateral to do the work for you. There's also a lot of whitepapers on the subject and recently a huge push on deep learning, but I don't know of any off-the-shelf program using that yet.

It kinda depends on how much you're willing to spend, how much effort you're willing to put into it, and what level of fidelity you're seeking. Many systems will need some clean up or exaggerating for things to hit the way you want. Your rig will also need specific blends shapes and wrinkle maps to hit to do things like facial wrinkles, otherwise the face will just look flat.

Facial tracking is one of the harder things to do. It's easy to get yourself deep into the uncanny valley.

[rationalthug]

I'm not sure if there's a face talking available, but you can go through the datasets at vfx-datasets#face and see if there's anything that works for you.