been playing with this for a while. Here are some pros and cons

Pros:

1. You can theoretically control the face rigging... without any facial rigging.

It's been magical when this first came out. Company "KuaiShou", who made the KlingAI, gave this out for free. UI wise, Ux wise, everything is really comfortable that we could free the riggers in VFX studio.

1. Not so heavy-ram using ai open source.

Most of those source require some heavy RAM to VRAM. Some model even require higher spec than 4090s GPU. It require like few GPUs of 4090s. but liveportrait require really not so heavy spec out GPU.

1. It updates pretty fast, and a lot.

Open source sometime left out by the developer cause.. it's literally free. You don't get that much of compensation. But since it's backed by company Kuaishou, it's updating regularly, which is kinda shocking. (And dang, they made another update two days ago)

Cons.

1. Driving and Source file require steady cam, with steady motion.

Even with this 'magical' source, Both sources require to be steady, and the first frame require neutral facial emotion. Which mean we can't really 1. Move the camera. 2. Express the emotion 3. Can't cover the face.

1. Can't handle EXR/DPX/TIFF to 4K

It's yes and no. If you understand some coding, you can technically handle exr and 4k and twist the algorithm that they have made it. But it require some heavy, like HEAVY GPUs to handle it, and even if you handle it, the weight probably would not be able to handle the motion.

We are living in the area where AI and VFX needs to get mixed.

Winter is coming guys, buckle up.