Part 8 of 13 · 1 min read
How to build it so it holds up
- State the criteria and the hard requirements before scoring.
- Remove failing and dominated options first.
- Use a break-even when the choice depends on one quantity such as traffic mix.
- Fix the scale in advance; do not rescale by the options present.
- Report the margin and the critical weight, not only the winner.
- Label every number: measured, quoted from a source, simulated or assumed.
- Write the reversal trigger as a measurable condition.
- Revisit decisions when the evidence or the models change.
- Prefer the simpler option unless a measured benefit justifies the complexity.