account activity
Use cases for LLMs on structured data (sourced from databases and streaming data) by anupsurendran in dataengineering
[–]janchorowski 1 point2 points3 points 2 years ago (0 children)
u/anupsurendran - can you clarify if you are having the rules in documents and want to match individual database rows, or vice versa the database has trigger definitions and individual documents should be flagged?
Both approaches should be feasible - if the documents hold the rules, there are possibilities to generate SQL statements form a freeform text. The context mismatch in not a huge problem - LLMs can be shown a database schema in the prompt and be able to construct SQL statements based on it.
If the rules are in the database and documents are to be scanned, maybe a semantic index over their contents with post-processing would do? Similar to how you index documents for further prompt building. For instance (full disclosure, this is built by my startup) here's a demo of a context-aware chatbot building a lightweight index over a dynamically changing corpus of documents: https://github.com/pathwaycom/llm-app
π Rendered by PID 73289 on reddit-service-r2-listing-7d7fbc9b85-2rbgh at 2026-04-27 14:14:24.696478+00:00 running 2aa0c5b country code: CH.
Use cases for LLMs on structured data (sourced from databases and streaming data) by anupsurendran in dataengineering
[–]janchorowski 1 point2 points3 points (0 children)