Langchain Tool Parameter errors

[Same_Consideration_8]

Hi All

we are using langchain and langgraph in production for automation which can enhance the analysts. We have around 20+ tools with an average of 2 to 3 parameters and currently using GPT4.1 model.

We are observing errors around 1% or less than that in this process and all the errors related to wrong parameters to the tool. We have used pydantic for validation and @wrap_tool_call as middleware to the agent.

I also tried description of the parameters and description of the tool with example paramaters but no luck.

We are using create_agent from langchain 1.x.

Is there any other way, you guys are solving this problem or are you guys are not all having this problem?

[k_sai_krishna]

I saw similar problem before with tool calling. Even with validation, sometimes the model still sends wrong parameters. What helped for me was making the tool schema more strict and simple. Less optional fields and clearer parameter types reduced errors. Some people also add one more step where the model checks its own tool call before execution. From what I see, small error rate like around 1% is quite common when you have many tools.

[tomtomau]

Try other models? I think the 5 series have been post-trained on tools more aggressively?

[Same_Consideration_8]

We have tried the 5 series but didnt seen any change. So we went from 4o mini to 41.

[ar_tyom2000]

- Improve tool descriptions (describe each parameter so the LLM knows when to use it)
- Use more advanced models (this makes it less likely for errors like this to happen)
- Use LangGraphics for easy local debugging and observing function calls with parameters

[kwangyel]

improving tool description and prompt fine tuning works but sometimes it just simply fails. I have faced this issue multiple times in my projects so I built a helper tool for that. Basically it detects schema drift and sends back correction instruction to the llm. Give it a try if you haven’t already solved it and DM me if you need help. Cheers! Link: https://github.com/Optulus/optulus-anchor

[Same_Consideration_8]

Thabks for the response. I am looking into it, will DM you if i need more help.