AI AGENT ADDONS

Evaluating AI agents is different from testing regular software. Agents make their own decisions and can take many paths to a goal. This skill explains how to judge their performance using outcome-focused methods.

Key ideas include multi-dimensional rubrics that score accuracy, completeness, and tool use. The 95% finding shows token usage drives most performance, followed by tool calls and model choice.

You will learn to handle non-determinism and build evaluation that catches regressions. Use LLM-as-judge and human evaluation for best results.

Add Agent Evaluation skill to your workflow

Global

mkdir -p ~/.claude/skills/agent-evaluation

Project

mkdir -p .claude/skills/agent-evaluation

Source Repository

Stars
1,185
Forks
128
Watchers
1,185
License
GPL-3.0
Last Push
1 month ago
Created
8 months ago