CSE Roadmap

Level 6 of 13 · about 2 weeks

Messaging, streams and pipelines

Moving data between systems without tying them together.

Modules

Core: everyone needs it. Common: most jobs use it. Specialist: optional depth, safe to skip on a first read.

  1. 1

    Queues and decoupling

    Load levelling, backlogs, acknowledgments and fault isolation

    Core 8 parts · about 4 hours

  2. 2

    Delivery guarantees

    At most once, at least once, exactly once and idempotent consumers

    Core 7 parts · about 4 hours

  3. 3

    Logs, topics and partitions

    Kafka-style logs, offsets, consumer groups and ordering

    Core 7 parts · about 4 hours

  4. 4

    Event-driven design and CQRS

    Events, event sourcing, read models and the cost of eventual views

    Common 7 parts · about 4 hours

  5. 5

    Batch processing

    Unix tools, the MapReduce idea, and joins and sorting at scale

    Common 7 parts · about 4 hours

  6. 6

    Stream processing

    Windows, time, state, joins and failure handling

    Common 8 parts · about 4 hours

  7. 7

    Change data capture and keeping systems in sync

    The dual write problem, derived data, and updating search and caches

    Common 7 parts · about 4 hours