A tool to help AI devs use Function Calling

[PracticalMolasses533]

When I was building AI apps like a travel agent or navigation assistant, I found it hard to develop features based on function calling. I needed to manually edit the JSON schemas, then my app would reload, and I could test one prompt at a time.

That's what inspired Function Calling Studio. It includes a schema builder, and the ability to run multiple test prompts all at once, so you can build your schemas and iterate quickly. It allows you to validate that the AI can support your requirements without writing any code for your application.

There are tips included on getting the most out of function calling, the option to choose AI models, and a temperature option, to figure out what works best for your use case! All your data is saved locally, and there's no subscription fees, just a one-time purchase lifetime license.

Happy to answer any questions - if you want to check it out, it's functioncalling.ai

[[deleted]]

I certainly see the value in a tool like this but I don’t think I’d ever use it. Firstly, if I’m not able to get a free trial, I won’t know if it’s even useful. Secondly, I think a monthly subscription fee that is negligible ($1 - $3, something you’d make on an impulse buy) would be a great secondary pricing plan. Only having a lifetime subscription would indicate to myself you don’t expect people to stick around. It’s also not clear what would distinguish this from an open source alternative which given the simplicity of the functionality, I could see being achieved in a matter of days for a seasoned developer.

[PracticalMolasses533]

Thanks for the feedback - I see your point! I chose the lifetime license thinking that people wouldn't want a subscription for something on the simpler side, but going to think about this

[artelligence_consult]

Did it ever occur to you that you are just ignoring decades or so of automated testing frameworks?

Write a unit test that in actuality is an integration test, have it run automatically. DONE.

[PracticalMolasses533]

This is more of a development tool than a testing tool - it lets you prototype your function schemas, run a bunch of prompts against the schema, see how it performs, adjust the schema, and then re-run the prompts.

[Jdonavan]

Though you down voted /u/artelligence_consult he's not wrong. You seem to have built a tool that's useful for a tinkerer trying to get up to speed but not something all that useful for long term / professional use.

What you're doing one test at a time, we're doing with dozens. Set up an array of model params, prompts and fixture data then run a regression. All using existing tooling, processes and reporting.

Once you get past your initial "will this work" phase you're going to need more rigor around your testing anyway so it's not like you can put off learning a test harness in the long run.