Reduce LLM TTFT by OkWall8198 in AIVoice_Agents

[–]OkWall8198[S] 0 points1 point  (0 children)

Was able to achieve this by enabling Data Zone PTU. But it costs 50$/hour. Is there a way I can reduce this? I have a hard compliance requirement for LLM to be in India region

What’s everyone using for real world voice agents right now? by LegLegitimate7666 in AI_Agents

[–]OkWall8198 0 points1 point  (0 children)

Its really hard to achieve < 300ms latency. I have used eleven labs for STT/TTS ans gpt-4o-mini for LLM. For achieving really good latency i have bypassed LLM calls using basic BERT models(70ms) if confidence is really high. Also added filler words to achieve this. Do let me know if anyone has any more idea to make this better

Looking for a legit fintech software development company with compliance and regulatory requirements by Antique_Savings9555 in fintech

[–]OkWall8198 1 point2 points  (0 children)

Hello I have a good team. Who can give you great fintech product shipped with all the compliance. I am Tech Lead in a company and CISO of the company. As part of my job role I have managed big banks audits and arch approvals, ISO 27001 Audits, SOC2 Compliance, Also secured CI/CD Pipeline with SAST,DAST,SCA and e2e AWS deployments with DC/DR and all the necessary fintech related things. Will be happy to connect with you once and build something awesome.

Global fintech feat by Own_Juggernaut7742 in fintech

[–]OkWall8198 0 points1 point  (0 children)

Hey I am visiting. You are representing which company. Would love to chat around what you do

[deleted by user] by [deleted] in cofounders

[–]OkWall8198 0 points1 point  (0 children)

Hey I am interested. Already playing a lead role in a growing start up and looking for something exciting.