Level 12 of 13 · about 3 weeks
Case studies III: infrastructure and money
Six systems that other systems run on: a message queue, metrics and alerting, object storage, a payment system, ad click aggregation and a real-time leaderboard.
Modules
Core: everyone needs it. Common: most jobs use it. Specialist: optional depth, safe to skip on a first read.
1
Design a distributed message queue
Topics, partitions, an append-only log, replicas, consumer groups and delivery guarantees
Core 8 parts · about 5 hours
2
Design metrics and alerting
Time series, collection by pull or push, a queue, a time-series database and alert rules
Common 8 parts · about 4 hours
3
Design object storage
Buckets and objects, a metadata store apart from a data store, replication, erasure coding and multipart upload
Common 8 parts · about 5 hours
4
Design a payment system
Pay-in and pay-out, a ledger, retries with idempotency, reconciliation and long-running payments
Core 8 parts · about 5 hours
5
Design ad click aggregation
Stream processing of click events, windows, late events, exactly-once results and recalculation
Common 8 parts · about 4 hours
6
Design a real-time leaderboard
Ranking millions of players with sorted sets, sharding and a rebuild path
Common 8 parts · about 4 hours