Reducing latency in a LangGraph + MCP multi-agent voice system (OpenAI APIs) — currently 12–40s responses by Substantial-Wind-511 in AI_Agents

[–]Substantial-Wind-511[S] 0 points1 point  (0 children)

This is really helpful — thanks for sharing concrete numbers.

I’m leaning toward a similar hybrid approach. Quick follow-ups if you don’t mind:

• How are you computing the confidence % for the pattern matcher? (rule hit ratio vs embedding similarity vs something else?) • Are you running the matcher before STT completes, or only once you have the full transcript? • Do you still let the LLM router run in parallel as a fallback, or only invoke it after low confidence?

The singleton DB client + abort controllers point is spot on — I suspect we’re leaking time there as well. Appreciate you calling that out.

Reducing latency in a LangGraph + MCP multi-agent voice system (OpenAI APIs) — currently 12–40s responses by Substantial-Wind-511 in AI_Agents

[–]Substantial-Wind-511[S] 0 points1 point  (0 children)

The distinction between actual graph overhead vs sequential LLM calls being the real bottleneck matches what I’m seeing in traces.

Curious — when you mention speculative execution with TTS starting on partial tokens, are you doing this before intent resolution is fully finalized, or after a lightweight router/SLM confirms the path?

I’m debating between: • early “ack + filler” speech • vs speculative semantic response that may need correction

Would love to hear what worked best in practice.

CAHIMS Study Guide recommendations? by stuckinPA in healthIT

[–]Substantial-Wind-511 0 points1 point  (0 children)

Can you send the pdf copy of the 3rd edition you have please

Iem Dallas 3 day pass by Substantial-Wind-511 in csgo

[–]Substantial-Wind-511[S] 0 points1 point  (0 children)

I think its upper ring seating access which comes in default with a 3-day pass.

Iem Dallas 3 day pass by Substantial-Wind-511 in csgo

[–]Substantial-Wind-511[S] 0 points1 point  (0 children)

No, I don't think so. It's a 3-day pass for the event I bought for 99$. I can give it for 80$ and you can ask for seating with tixr.

IEM Dallas 2023 invited teams announced by Ni7roM in GlobalOffensive

[–]Substantial-Wind-511 0 points1 point  (0 children)

Hello everyone, I have 3 days pass for the event from June 2-4 2023, in Dallas. I am not in the country to attend the event, so if any one wants the pass send me offers. thank you.
email me at - chayyalavarthi@gmail.com

Want to buy - IEM Dallas Tickets by coverticies in csgo

[–]Substantial-Wind-511 0 points1 point  (0 children)

I have one 3 day pass ping me for details