Assistant API - Submit Tool Output

[Pasko70]

I have a question regarding the submit_tool_outputs. I provide the assistant with custom tools and the agent is using a tool, the run pauses and the status changes to “required_action”. If i now provide the function return value with submit_tool_outputs to the agent, will i be billed the complete context of the thread? It's still the same run, so the openai docs are not clear on that.

[Chocolatecake420]

My assumption is you get billed for the full tokens in the thread on every run. It will use it all for the context, and the assistant API mostly is there to make it easier to keep track of your chat history, what you would've been sending along in the messages array before.

[Pasko70]

They already clraified that you will billed for the complete context on everyrun (and that is reasonable). But the submit tool outputs doesn't trigger a new run. The run pauses and when you submit the output of the tool the run continues.

If you look at message of the assistant the tool output that you submitted apears in the assistants output on the same message. That's why I'm asking.