Level 6 of 13 · about 2 weeks
Messaging, streams and pipelines
Moving data between systems without tying them together.
Modules
Core: everyone needs it. Common: most jobs use it. Specialist: optional depth, safe to skip on a first read.
1
Queues and decoupling
Load levelling, backlogs, acknowledgments and fault isolation
Core 8 parts · about 4 hours
2
Delivery guarantees
At most once, at least once, exactly once and idempotent consumers
Core 7 parts · about 4 hours
3
Logs, topics and partitions
Kafka-style logs, offsets, consumer groups and ordering
Core 7 parts · about 4 hours
4
Event-driven design and CQRS
Events, event sourcing, read models and the cost of eventual views
Common 7 parts · about 4 hours
5
Batch processing
Unix tools, the MapReduce idea, and joins and sorting at scale
Common 7 parts · about 4 hours
6
7
Change data capture and keeping systems in sync
The dual write problem, derived data, and updating search and caches
Common 7 parts · about 4 hours