Agent Evaluation

Acerca de este Skill

Build evaluation datasets, run and grade agent traces, and investigate failures.

Por qué lo elegimos

Covers dataset schema, metrics, judge configuration and an iterative eval-and-fix workflow.

Para qué sirve

• Covers dataset schema, metrics, judge configuration and an iterative eval-and-fix workflow.

Scope and use

Covers dataset schema, metrics, judge configuration and an iterative eval-and-fix workflow.

Install the suite together: this task refers to the shared workflow and other Skills. Actual cloud operations depend on your project configuration and require the appropriate authorization.

Antes de usarlo

• The Skills work with a coding agent and the bundled references. Task execution uses agents-cli; upstream lists Python 3.11+, uv and Node.js. Local model calls require configured provider access; cloud deployment needs a Google Cloud project and may incur charges.