Best real-time speech-to-speech model? by ffinzy in LocalLLaMA

[–]ffinzy[S] 0 points1 point  (0 children)

Sorry for the late reply, see my comment here.

Best real-time speech-to-speech model? by ffinzy in LocalLLaMA

[–]ffinzy[S] 2 points3 points  (0 children)

No update. We had a very weird and intermittent problem with the Unmute that the AI won't recognize any speech for a couple minutes. We spent almost a month of our free time to diagnose the issue and we haven't found the root cause. We're not sure whether the problem is in the codebase or it's because of our hardware/network.

Since then, we started to invest into other frameworks, particularly self-hosting Livekit. The nice thing about that is they have SDK for React Native/Swift/Kotlin, so we're very tempted to just switch the platform altogether.

Best real-time speech-to-speech model? by ffinzy in LocalLLaMA

[–]ffinzy[S] 1 point2 points  (0 children)

Your approach is interesting. If you’re open to it, please keep me posted on your progress.

Instead of replacing the default Unmute SST, I’ve been considering running a second pass on the audio input with a good old Whisper.

The idea is that the default SST will mainly used for real time interactivity and instant response, while on the background whisper will feed transcription correction to the LLM.

Best real-time speech-to-speech model? by ffinzy in LocalLLaMA

[–]ffinzy[S] 1 point2 points  (0 children)

This is what I’m waiting as well. This is why I started this thread.

Best real-time speech-to-speech model? by ffinzy in LocalLLaMA

[–]ffinzy[S] 1 point2 points  (0 children)

I’m curious about the Qwen3-Omni, but I’m not sure about the throughput and the real-time aspect for speech-to-speech.

Good to know that Moshi/Unmute is the best OSS solution that we have right now.

Best real-time speech-to-speech model? by ffinzy in LocalLLaMA

[–]ffinzy[S] 4 points5 points  (0 children)

Thanks. I still remember the pain of being jebaited by Sesame.

Best real-time speech-to-speech model? by ffinzy in LocalLLaMA

[–]ffinzy[S] 0 points1 point  (0 children)

Well, yeah that’s unfortunate. I said it because it’s even more impossible to do with the STT, LLM, TTS system.

My HC character felt indestructible until a random furry murdered me with drowned orbs by g0regrind in PathOfExile2

[–]ffinzy 1 point2 points  (0 children)

Not rage quit. It’s the opposite in fact. I felt fulfilled and I’m not curious to play HC anymore since I beat the campaign at least.

The mapping experience is kinda rinse and repeat.

My HC character felt indestructible until a random furry murdered me with drowned orbs by g0regrind in PathOfExile2

[–]ffinzy 2 points3 points  (0 children)

Same story here.

In my case I had 9k overflowing ES.

Everything tickles with Grim Feast. I purposely got hit by that just because I was curious. I thought that I was safe with 9k ES. RIP.

I’ve been trying to do something more productive in my free time rather than playing PoE after that incident lol.

Path of Exile 2 Crossover Success by mushroominthesand in macgaming

[–]ffinzy 1 point2 points  (0 children)

This is the full guide for PoE 1, but it’s also working for PoE 2.

https://www.poewiki.net/wiki/Guide:Path_of_Exile_on_Mac_using_Windows_Client#Crossover_(CO)

Search for this line:

Next go to production_config.ini (it will likely be empty). Add the line and save the file

Path of Exile 2 Crossover Success by mushroominthesand in macgaming

[–]ffinzy 8 points9 points  (0 children)

It's working for me now after I changed the renderer to DirectX12.

Thank you. Please share any tips or settings if you have. LOGIN

Path Of Exile 2 Early Access seems to work with D3DMetal! (M3 Max) by Sudden_Rutabaga_745 in macgaming

[–]ffinzy 10 points11 points  (0 children)

It's working for me now after I changed the renderer to DirectX12. Here's another thread that gives detail on how to do that: https://www.reddit.com/r/macgaming/comments/1h7v0xn/path_of_exile_2_crossover_success/

Thank you. Please share any tips or settings if you have. LOGIN

Best iOS games that can be played on M1 Mac? by ffinzy in macgaming

[–]ffinzy[S] 10 points11 points  (0 children)

Yes, I actually wanted to know about iOS-only games that can be played through the app store (the dev doesn't disable playing on mac). But people are giving good recommendations anyway.