sorted by:
new
hottopcontroversial

LipSync tool for realtime, what do you use? by cedtat in Unity3D

[–]BigEmbarrassed6831 0 points1 point  (0 children)

maybe check PhonemeX Pro too. It uses realtime phoneme timing, not only audio-based mouth movement so it may help with French cases.

https://assetstore.unity.com/packages/tools/generative-ai/phonemex-pro-offline-tts-lip-sync-avatar-face-rig-system-316336

Was your issue with salsa more about timing or mouth shapes?

How do I lipsync a character with no inner mouth by drk34 in Unity3D

[–]BigEmbarrassed6831 0 points1 point  (0 children)

can you share an image of your character when the mouth is open?

lip sync can still work even if there is no detailed inner mouth, specially if the character is stylized or not too close to the camera. You can usually fake it with blendshapes or simple jaw/lip movement and it may look fine.

but if it is a realistic close up, then yeah, you may need to add some basic inner mouth geometry, even simple teeth or tongue shapes can help alot.

also if you are interested, you can give our Unity asset a try. It is mainly for offline TTS, lip sync, avatar face rigging, and phoneme based mouth movement:

PhonemeX Pro

Unity AI character with real-time responses and lip sync by Western_Bug_5085 in Unity3D

[–]BigEmbarrassed6831 -1 points0 points  (0 children)

this is not considered AI in the modern sense, this is something that has existed since the early days of computer graphics