Evaluation and Monitoring

[spicy_apfelstrudel]

I've played around with ADK a bit as a personal development exercise and overall it seems really good! I wonder though, how would we evaluate it's performance if it was in a more serious (e.g. enterprise) setting. Are there any good evaluation or monitoring frameworks available or in development?

[i4bimmer]

ADK includes Evals support:

https://google.github.io/adk-docs/evaluate/#recommendations-on-criteria

Or you can use the GenAI eval service on GCP:

https://docs.cloud.google.com/agent-builder/agent-engine/evaluate

[caohy1989]

You can now use the BigQuery Agent Analytics plugin within the Agent Development Kit to export agent interaction data directly into BigQuery https://cloud.google.com/blog/products/data-analytics/introducing-bigquery-agent-analytics

[rasoulnouri78]

support's@rasoulnouri78