CSE Roadmap

Level 8 of 12 · about 3 weeks

Storage and I/O devices

How hard disks and flash drives work, how requests are ordered, how the processor talks to a device with polling, interrupts and DMA, how the kernel layers its I/O code, how RAID survives failures, and how to measure and diagnose storage on Linux.

Modules

Core: everyone needs it. Common: most jobs use it. Specialist: optional depth, safe to skip on a first read.

  1. 1

    How a hard disk works

    Platters, seek, rotation and why random reads are hundreds of times slower than sequential ones

    Core 7 parts · about 3 hours

  2. 2

    Disk scheduling

    Choosing the order of waiting requests so that the arm moves less

    Core 7 parts · about 3 hours

  3. 3

    SSDs and flash storage

    Pages, blocks, the flash translation layer, write amplification and TRIM

    Core 7 parts · about 3 hours

  4. 4

    I/O hardware, polling, interrupts and DMA

    How the processor talks to a device, and three ways to move the data

    Core 7 parts · about 3 hours

  5. 5

    The I/O software stack

    Layers, device files, drivers, buffering, caching and blocking against non-blocking I/O

    Core 7 parts · about 3 hours

  6. 6

    RAID

    Combining many disks for speed and for survival, with parity worked out in XOR

    Core 6 parts · about 3 hours

  7. 7

    Measuring storage on Linux

    IOPS, throughput, latency and utilisation, read from /proc/diskstats and checked with dd

    Core 7 parts · about 3 hours

  8. 8

    Case study, why is the disk slow

    A slow log writer investigated with counters, fsync and batching

    Core 7 parts · about 3 hours