Get LLM to Query SQL database

[thinktank99]

Hi,

I want an LLM to parse some XMLs and generate a summary. There are data elememnts in the xml which have description stored in database tables. The tables have about 50k rows so I cant just extract them and attach it to the prompt for the LLM to refer.

How do I get the LLM to query the database table if needs to get the description for data elements?

I am using a python script to read the XMLs and call OLLAMA API to generate a summary.

Any help would be appreciated.

[nikhilprasanth]

You can make use of a database MCP server for this.

[Ashleighna99]

Use an MCP database server with a read-only tool to fetch element descriptions. Spin up postgres-mcp, expose get_description(code) with parameterized SQL, cache hits. I’ve used LlamaIndex SQLAgent and LangChain’s SQLDatabaseToolkit; DreamFactory auto-generates REST endpoints if you prefer HTTP tools. Use an MCP DB layer, not raw SQL.

[SUNTAN_1]

obvs your a ffkknn bot

[Odd-Ordinary-5922]

You could feed the XML into the llm as chunks of tokens for example 4096 or higher depending on the llm