CSE Roadmap

Level 12 of 13 · about 3 weeks

Case studies III: infrastructure and money

Six systems that other systems run on: a message queue, metrics and alerting, object storage, a payment system, ad click aggregation and a real-time leaderboard.

Modules

Core: everyone needs it. Common: most jobs use it. Specialist: optional depth, safe to skip on a first read.

  1. 1

    Design a distributed message queue

    Topics, partitions, an append-only log, replicas, consumer groups and delivery guarantees

    Core 8 parts · about 5 hours

  2. 2

    Design metrics and alerting

    Time series, collection by pull or push, a queue, a time-series database and alert rules

    Common 8 parts · about 4 hours

  3. 3

    Design object storage

    Buckets and objects, a metadata store apart from a data store, replication, erasure coding and multipart upload

    Common 8 parts · about 5 hours

  4. 4

    Design a payment system

    Pay-in and pay-out, a ledger, retries with idempotency, reconciliation and long-running payments

    Core 8 parts · about 5 hours

  5. 5

    Design ad click aggregation

    Stream processing of click events, windows, late events, exactly-once results and recalculation

    Common 8 parts · about 4 hours

  6. 6

    Design a real-time leaderboard

    Ranking millions of players with sorted sets, sharding and a rebuild path

    Common 8 parts · about 4 hours