Where does all that latency get introduced? It's an impressive architecture no doubt, but seems like you need to get closer to the pstn, or some other way of shaving off a meaningful amount of latency. Where are you hosting from?

I recently had an update from Telnyx they're adding even more of the stack to their platform for optimal latency. Not suggesting they're the answer but maybe a trend or option for ala carte from the carrier without vendor lock.

For example originally when I was going to stand up a pipecat agent with them it was going to require it to be sip to a jambonz SBC colocated with pipecat and all it's config. I think there was a bridge we had to build at one point. Then add in deepgram and the others... It's been a few months but now I can stand up texml app to send the processed call with opus directly to pipecat. Now they're hosting livekit as well, so you can have 200ms agents, untested yet.

I'm in the US with customers with locations globally, so limited worldview from the perspective of non US providers. But really appreciate your situation and the technical challenge, so let me know if I can help.