EVALS & OBSERVABILITY • 242 / 397
Measure whether the AI is good and trace where it fails.
Tool Success Rate
Tool success rate measures whether tool calls execute successfully and return usable results.
Think of it like
Think of Tool Success Rate like testing and telemetry for any production service: quality must be measured, not guessed.
Real life
Teams use Tool Success Rate to decide whether a new release is safer, faster or more useful.
SRE lens
A model can choose the right tool but still fail because arguments or permissions are wrong.
Remember thisTool success rate measures whether tool calls execute successfully and return usable results.