Overview of strands-evals subcommands
mainThe strands-evals CLI exposes five primary subcommands:
| Command | Purpose |
|---|---|
strands-evals run | Execute an Experiment against an --agent factory or --task callable, or run a single ad-hoc case via --input + --evaluator/--expected-output/--rubric. |
strands-evals validate | Schema-check a serialized Experiment JSON file. Useful as a CI gate before run. |
strands-evals report | Render an existing EvaluationReport JSON via Rich, or dump it as JSON. |
strands-evals diagnose | Run detect_failures, analyze_root_cause, or the full diagnose_session pipeline on a Session JSON file. |
strands-evals generate | Synthesize an Experiment via ExperimentGenerator from a free-form --context or an existing --experiment file. |