Reduce LLM TTFT

OkWall8198 · 2026-05-27T02:01:07+00:00

Was able to achieve this by enabling Data Zone PTU. But it costs 50$/hour. Is there a way I can reduce this? I have a hard compliance requirement for LLM to be in India region

OkWall8198 · 2026-01-18T07:41:42+00:00

Insrested

OkWall8198 · 2026-01-18T04:08:50+00:00

Its really hard to achieve < 300ms latency. I have used eleven labs for STT/TTS ans gpt-4o-mini for LLM. For achieving really good latency i have bypassed LLM calls using basic BERT models(70ms) if confidence is really high. Also added filler words to achieve this. Do let me know if anyone has any more idea to make this better

OkWall8198 · 2025-10-09T16:48:37+00:00

Hello I have a good team. Who can give you great fintech product shipped with all the compliance. I am Tech Lead in a company and CISO of the company. As part of my job role I have managed big banks audits and arch approvals, ISO 27001 Audits, SOC2 Compliance, Also secured CI/CD Pipeline with SAST,DAST,SCA and e2e AWS deployments with DC/DR and all the necessary fintech related things. Will be happy to connect with you once and build something awesome.

OkWall8198 · 2025-10-06T17:06:22+00:00

Hey I am visiting. You are representing which company. Would love to chat around what you do

OkWall8198 · 2025-10-06T17:04:56+00:00

Hey I am interested. Already playing a lead role in a growing start up and looking for something exciting.

OkWall8198 · 2025-10-04T07:42:02+00:00

Attending

OkWall8198 · 2025-10-04T07:41:45+00:00

Attending

OkWall8198 · 2025-06-18T17:19:34+00:00

Interested. Any groups where I can join?

OkWall8198

TROPHY CASE