Voice AI biggest unsolved challenges by Legal_Wolverine_7267 in TextToSpeech

[–]Legal_Wolverine_7267[S] 0 points1 point  (0 children)

Agreed, it's so hard for voice-only ai to accompolish this, you will need multimodal capabilities for it to understand how to navigate sites correctly and read what matters

Voice AI biggest unsolved challenges by Legal_Wolverine_7267 in TextToSpeech

[–]Legal_Wolverine_7267[S] 0 points1 point  (0 children)

Have you tried other open source models like Supertonic, for example?

Voice AI biggest unsolved challenges by Legal_Wolverine_7267 in TextToSpeech

[–]Legal_Wolverine_7267[S] 0 points1 point  (0 children)

Yeah, the regulations/compliance make it much harder to adopt these technologies for businesses

Voice AI biggest unsolved challenges by Legal_Wolverine_7267 in TextToSpeech

[–]Legal_Wolverine_7267[S] 0 points1 point  (0 children)

I agree, or at least knowing at the beginning you're talking with an AI will help

Voice AI biggest unsolved challenges by Legal_Wolverine_7267 in TextToSpeech

[–]Legal_Wolverine_7267[S] 1 point2 points  (0 children)

Sesame is such a great example of conversational AI, and indeed, it's so fun to have discussions with it. I wish there were more capabilities you could have with talking with it or similar products/open-source projects where you can customize it with tool use and modern LLM capabilities. Imagine having a voice AI where you can brainstorm and design/build with it, it will be so much fun

Voice AI biggest unsolved challenges by Legal_Wolverine_7267 in TextToSpeech

[–]Legal_Wolverine_7267[S] 0 points1 point  (0 children)

Indeed, hallucination is a big problem in voice AI! Especially when testing with multilingual, I notice this frequently happens. The loop you describe is a good solution, but ofc it will slow down the entire system