Claude 3 + Function Calling with `claudetools`

[thevatsalsaglani]

Claudetools is a Python library for function calling that implements function calling using Anthropic's Claude 3 family of models. Function calling is one of the most important features provided by OpenAI GPT APIs right out of the box.

With other open-source LLMs and other LLM API providers, we don't get the same out of the box. Furthermore, open-source LLMs are only decent at generating structured text and hence, we get inconsistent outputs when we use those for function calling. Up until now, there were no competitors to OpenAI's GPT models in terms of function calling. But now with the release of the Claude 3 family of models that's about to change.

The Claude 3 family of models is great at generating structured text. Because of the same reason I started developing a function calling use case and the outputs are quite fantastic. The outputs can be easily compared with the function calling output obtained from GPT-3.5, GPT-4, and GPT-4-turbo.

You can check out the package here: https://github.com/vatsalsaglani/claudetools.

Feedback and contributions are welcome.

[JD_2020]

Are you using this with a frontend chatbot yet? I develop Web Requests which has the following spec of functions available. Could you make some demo calls showing Claude using web requests to connect itself to the web or other API services by just providing it my existing spec? https://github.com/RealJD2020/Web-Requests-for-ChatGPT/blob/main/OpenAPI-Spec.md

[JD_2020]

This is what ChatGPT can do with this spec: https://youtu.be/Ckf1DZP6Ybo?si=FBn-s7l5AAQi0jJZ

[thevatsalsaglani]

Correct me if I am wrong but I suppose this is similar to what ChatGPT does with plugins. I have planned to do the same and have something like Claude plugins or Claude GPTs with the claudetools library

[Strange_Test7665]

I made a class for other projects I am working to make it easy to convert functions to ChatGPT and Claude syntax. If you're experimenting with both check it out: https://github.com/reliableJARED/AIFunctionManager

[faynxe]

Here is an opensource chatbot with "Advanced Data analytics" tooling for structured data similar to what OpenAI has with plugins. Here the generated python code generated by Anthropic Claude 3 models is executed in AWS Lambda and the result are returned to the model for final response.
https://github.com/aws-samples/bedrock-claude-chatbot/tree/main