Continuing to hammer a failing model provider or tool wastes capacity and extends latency.
RESILIENCEAI SRE
Circuit Breakers
A circuit breaker temporarily stops calls to an unhealthy dependency so the wider system can recover or use a fallback.
After repeated provider timeouts, the circuit opens for 30 seconds and eligible traffic uses a fallback model.
What health signal opens and closes the circuit?
REMEMBERCircuit breakers prevent one sick dependency from infecting the entire request path.
No uploads · No company data · No account required