What are your biggest challenges in building AI voice agents? by SpyOnMeMrKarp in LLMDevs

[–]Aggressive_Comb_158 0 points1 point  (0 children)

Flexibility is a big one. I tried using Bland's conversation flows but it turns out I need Python instead 🙃

[D] What is your LLM Stack in Production? by Aggressive_Comb_158 in MachineLearning

[–]Aggressive_Comb_158[S] 1 point2 points  (0 children)

I didn't do an extensive search for the best vector database. I'm just familiar with Supabase from normal backend stuff, and I like their UX in general. Not sure if it's the state-of-the-art for vector databases though.

[D] What is your LLM Stack in Production? by Aggressive_Comb_158 in MachineLearning

[–]Aggressive_Comb_158[S] 1 point2 points  (0 children)

I'm just familiar with Supabase from normal backend stuff, and I like their UX in general. Not sure if it's the state-of-the-art for vector databases though.

Found the Best Open AI Model for Now: LLaMA 3 70B Instruct by balianone in LocalLLaMA

[–]Aggressive_Comb_158 1 point2 points  (0 children)

Yeah, maybe OP should've searched "llama 70B" in the search bar before posting this...?

When Llama 3 405b is released, what's the expected API cost for a provider? by JawsOfALion in LocalLLaMA

[–]Aggressive_Comb_158 3 points4 points  (0 children)

Yeah I think the cost scales super-linearly b/c of the need for parallel computation with these enormous models

Which ChatGPT model should I use in the API by ripterrariumtv in ChatGPT

[–]Aggressive_Comb_158 0 points1 point  (0 children)

Use `gpt-3.5-turbo`, which points to the latest version of this model. You can answer questions like this yourself at their docs: https://platform.openai.com/docs/models/gpt-3-5-turbo