Retries that make outages

2026-09-30

An overloaded service answers slowly; clients time out and retry; the retries add load to something already slow. The failure is not the original latency, it is the retry policy amplifying it.

Jittered exponential backoff with a cap is the usual fix, but it only works if the client budget is bounded too. Unbounded retry with backoff is still unbounded.

← all notes