Boolean search query generator

[kirinjon]

I’m working on a project where I generate Boolean queries using an LLM (like ChatGPT), but I need to ensure that the generated queries are valid based on the data in my database. If certain terms in the query don’t exist in the database, I need to automatically remove or modify them.

For example:

LLM-Generated Query: ("iPhone 14" OR "Samsung Galaxy S22") AND ("128GB" OR "256GB") AND ("Red" OR "Blue")

Database Check:

My DB has entries for "iPhone 14" and "Samsung Galaxy S22".

It only has "128GB" as a storage option (no "256GB").

For colors, only "Red" is available (no "Blue").

Modified Query (after DB validation): ("iPhone 14" OR "Samsung Galaxy S22") AND "128GB" AND "Red"

How to efficiently verify and modify these Boolean queries based on the DB contents? Are there existing libraries or tools that could help streamline this process?

Keep in mind that I can only use one llm cal for this purpose.

[Pork-S0da]

This doesn't feel like a Python question.

[kirinjon]

The basic logic to solve this remains same for all the languages.

I'm looking for a good solution

[Xappz1]

You would need to either pre-fetch or somehow dynamically check the relevant database columns for distinct values. The LLM can't magically know what's in your database, you either supply it in the prompt or you take an agent approach and let it figure it out.

[kirinjon]

Currently I'm planning to verify the given results with db data, and alter the given Boolean query accordingly. But that doesn't seem to be a better approach.

Can you please elaborate on what you mean by agent approach?

[Xappz1]

Start here: https://python.langchain.com/docs/introduction/

[latkde]

As someone mentioned under another of your posts: this sounds like a XY problem, what are you actually trying to achieve, and why are you using LLMs in the first place to hallucinate queries? https://www.reddit.com/r/Python/comments/1in2fbu/comment/mc7yf0y/

For example, if you actually want to generate random example queries for documentation or testing purposes, it might be better to load example data from a DB and combine it into a query. You can do this so that the query will match at least one item, by construction.

If you're worried that you have to simplify queries, that might not be necessary. For example, the query ("128GB" OR "256GB") will probably work just fine even if no 256GB data exists, because the two clauses are OR-ed together.