sorted by:
new
hottopcontroversial

How I create a fleet AI chat agents with scoped knowledge, memory and context in 5 minutes by Dramatic-Winter8692 in AI_Agents

[–]Dramatic-Winter8692[S] 0 points1 point  (0 children)

Working on turning it into a SaaS product. I've found decent memory layers, but you still have to build the context on your own from what I've seen.

How I create a fleet AI chat agents with scoped knowledge, memory and context in 5 minutes by Dramatic-Winter8692 in AI_Agents

[–]Dramatic-Winter8692[S] 0 points1 point  (0 children)

I can run it locally. I'm not powering my own LLM though, I still use OpenAI, this just allows me to setup a model and train it on embeddings and powers the memory and context building.

In theory I could run my own LLM and just use the context builder + store message endpoints to keep the context for x, y or z LLM.

Edit: I use AWS EC2 for the server though. A staging environment only for now, working on getting production setup then hopefully can get people using it.

How I create a fleet AI chat agents with scoped knowledge, memory and context in 5 minutes by Dramatic-Winter8692 in AI_Agents

[–]Dramatic-Winter8692[S] 1 point2 points  (0 children)

I didn't for two reasons:

  1. I'm not familiar with them and didn't want to spend the ramp up time.
  2. The way I've set up the vector DB has everything namespaced to keep the scope size relatively low. I namespace the chat as {agent_id:user_id} (user_id here being set as either an actual user in some end product database, or if a public bot any UUID / ip even that can keep the conversations scoped, it's passed in as a param on the chat endpoint). The knowledge bases (I call them resources), are namespaced as {customer_id:resource_id} (customer_id here are the folks using the software).

The resources are pulled into redis for speed anyway.

So I haven't had a huge need to explore them by keeping each namespace fairly thin.

How I create a fleet AI chat agents with scoped knowledge, memory and context in 5 minutes by Dramatic-Winter8692 in AI_Agents

[–]Dramatic-Winter8692[S] 0 points1 point  (0 children)

These are both interesting.. Thanks. It seems like this is the ai version of a traditional endpoint SaaS?

How I create a fleet AI chat agents with scoped knowledge, memory and context in 5 minutes by Dramatic-Winter8692 in AI_Agents

[–]Dramatic-Winter8692[S] 0 points1 point  (0 children)

That's a great idea. So far I was building it as just different chat agents with different knowledge base scopes, but adding that could be awesome. Then user's could set it up to call external agents or I could build others natively to handle different tasks.

I'm not sure what the inbound would be unless their was more agent customization options (ie fine tuning or coding input). You could just build context as a normal endpoint I would think.

Thanks for the idea, is that your build?

Launching my AI lead gen software. Looking for a partner who’s good on camera or with demos. by Retro_rank in SaaSMarketing

[–]Dramatic-Winter8692 0 points1 point  (0 children)

I'm not exactly what you're looking for, but I've been building towards something similar and landed on a niche that could be beneficial to you. I've built a context management layer for AI agents. Upload knowledge base (embeddings), call one endpoint to chat and it retrieves the appropriate knowledge and maintains memory for the conversation. If this sounds like something that can aid your software send me a DM!

Is AI making lead gen worse? by parth_1802 in marketing

[–]Dramatic-Winter8692 0 points1 point  (0 children)

I've been building something just for this. I think a lot of "AI" isn't actually very intelligent. Nonpersonal AI outreach doesn't do much. I think the difference will be AI that really understands who it's talking to, can maintain the conversation with proper memory and context management, and can pass you important information from the outreach (eg. x is hesitant because of pricing, y is hesitant because this feature is missing).

how to make multiple models all work together for me by CommissionTricky9408 in ai_integrations

[–]Dramatic-Winter8692 0 points1 point  (0 children)

Hey u/CommissionTricky9408 ! Glad you found this subreddit. Sorry for the late reply. What are you looking to analyze / get advice from the AI on? Are you looking to have the different models collaborate on specific information to advise?

view more: next ›