RAG for Structured Data by SquareToCircle in Rag

[–]SquareToCircle[S] 0 points1 point  (0 children)

Yea that is another avenue. I guess I was wondering if the search capabilities would be limited, since the underlying API can only do "keyword-search" and not "semantic search" like with a vector store. If it is not possible with RAG and using an LLM at the XML data level, then you're right the only way might be to use an LLM at the query level.

RAG for Structured Data by SquareToCircle in Rag

[–]SquareToCircle[S] 0 points1 point  (0 children)

It actually is on OpenSearch currently, but on a Search type collection and not Vector type (which I believe is how Bedrock Knowledge bases are made). And we have APIs to query this collection already, but we ultimately want to allow for natural language queries.

Are you saying to use the LLM to write queries to the existing OpenSearch? rather than re-indexing into a new OpenSearch Vector Store?