EVALS & OBSERVABILITY • 240 / 397
Measure whether the AI is good and trace where it fails.
Pass Rate
Pass rate is the percentage of eval cases meeting defined success criteria.
Think of it like
Think of Pass Rate like testing and telemetry for any production service: quality must be measured, not guessed.
Real life
Teams use Pass Rate to decide whether a new release is safer, faster or more useful.
SRE lens
Track whether the new agent release passes 92% or 97% of incident cases.
Remember thisPass rate is the percentage of eval cases meeting defined success criteria.