AI retries are expensive and may include long prompts, provider charges and repeated tool actions.
INCIDENT RESPONSEAI SRE
Incident: Retry Storm
A retry storm happens when clients or services multiply load against an already degraded dependency.
A provider returns 429s; three retry layers each attempt twice, turning one user request into eight provider calls.
Where should retry responsibility live, and how do you cap amplification?
REMEMBERRetries can become the incident.
No uploads · No company data · No account required