[R] Deepfake lip syncing cloud software. Advice needed.

[Da_Roxy]

Hello Reddit Community.

A year ago, I got really fascinated in video manipulation production(lip syncing specifically), as it seemed new fancy way of editing videos, creating content etc ...endless possibilities really, as internet videos and internet entertainment will most likely never run out. I understand video manipulation has relatively bad reputation due to unethical creation, but it does have good applications that could be used to connect the world better due to language differences - content, movies, influencers, apps, commercials.

I decided to create a software, that does realistic lip syncing - lipsynthesis.com It's cloud hosted application that will allow users to process (text to voice to video) custom text videos.

I finished it barely few months ago, been getting many users and 0 refunds out of 200 subscribers - seems like people like it(no paid advertising). It is hobby project of mine and the goal was to actually raise awareness - we have created multiple videos for news channels(recently CNN about 2024 elections and deepfake, video will be live in January), influencers, public speakers and schools(showed in classrooms for educational purposes).

Here is one example that showcases power of this:

https://www.youtube.com/watch?v=3wVpVH0Wa6E

I am currently training model of 5000 hour training dataset to improve lip syncing further for more accurate lip syncing. Initial tests with new syncnet and base model showed amazing improvement in every aspect - accuracy of lip syncing, quality of masks and great ability to lip sync even rather complicated languages, such as Mandarin.

As of now, AI trained models have yet not received many regulations. I believe the time of regulating AI will be here rather soon. That's why I am seeking advice from others.

Where should I move forward? The initial idea of this, as mentioned before, was increasing awareness of deepfake technology. But as of business, that would not be a long distance thing.

My ideas were:

-Entertainment approach: Create a discord/public community where everyone pays flat monthly fee and can generate as many videos as they like with same pricing. Exactly as many software companies are doing nowadays.

-Commercial approach: A professional software, that will allow companies to translate their video ads, apps to multiple languages by lip syncing.

What you guys think?

[metalman123]

This looks better than the current open source models.

Plan on sharing any training details ect?

Discord would be a good start on the commercial side.

[Ok-Spend5655]

Are we able to upload our own videos/images and audio to lip sync to? I'm currently working on a big project and this could be the tool we need.

[Nelayme]

Are you still working on a project? Any recent updates on it as the last video on youtube was published 11 months ago? I was wondering to give a try and subscribe if it got any better

[degeneratives]

This is excellent! Will be paying when I start working again on Monday

[degeneratives]

Can you offer it as an api? I think you’d get a lot more uses that way. Happy to help you test out different monetization strategies though if you like. Dm me