Level 10 of 13 · about 3 weeks
Case studies I: core components
Six small systems that larger designs reuse: a rate limiter, an ID generator, a key-value store, a URL shortener, a web crawler and a notification system.
Modules
Core: everyone needs it. Common: most jobs use it. Specialist: optional depth, safe to skip on a first read.
1
Design a rate limiter
Where it sits, where the counters live, and how many servers share them
Core 8 parts · about 4 hours
2
Design a unique ID generator
Four ways to make IDs, and why the 64-bit time-based layout wins
Core 7 parts · about 3 hours
3
Design a key-value store
Partitions, copies, quorums, conflicts, failures and the write and read paths
Core 8 parts · about 5 hours
4
Design a URL shortener
Two APIs, a 7-character code, a read-heavy cache and the 301 or 302 choice
Core 7 parts · about 3 hours
5
Design a web crawler
A frontier that stays polite, seen-checks for URLs and content, and traps to avoid
Common 7 parts · about 4 hours
6
Design a notification system
Push, SMS and email through queues, with retries, no lost messages and user settings
Core 8 parts · about 4 hours