Part 10 of 12 · 1 min read
Quick notes
- Every dependency will fail eventually, and an agent with no retry or fallback crashes outright on one bad call.
- Layers, outermost to innermost: rate limiter, timeout, retry with budget, circuit breaker, fallback chain, bulkheads.
- Retries amplify across layers. Three retries at three layers is 64 attempts; retry at one layer only, under a budget.
- A breaker stops hammering a dependency; only a fallback restores success. Decide which fallbacks are allowed and test them.
- Smooth bursts with a token bucket and isolate tools in separate worker pools so one hung dependency can't freeze another.