How Complex Systems Fail (1998)(how.complexsystems.fail)
372 points by shortcrct 18 days ago | 77 comments
tl;dr: Richard Cook's classic essay argues that complex systems (healthcare, aviation, power) are inherently hazardous and always run in a degraded mode with latent failures; catastrophes require multiple small failures to align, not a single "root cause." Human operators are the adaptive element that continuously creates safety by gambling under uncertainty, though hindsight bias causes investigators to unfairly label their actions as errors after accidents. Safety is an emergent property of the whole system, not a component that can be added, and post-accident fixes often increase complexity and introduce new failure modes.
HN Discussion:
  • Endorses the paper as essential reading for understanding real-world complex system failures and root cause fallacies
  • Shares practical experience confirming systems run in degraded mode kept alive by human operators
  • Suggests engineering practices like Chaos Engineering as applications of the paper's insights
  • Recommends complementary works and frameworks (Normal Accidents, Safety II, Systemantics) that extend the argument
  • Extends the article's warning to other domains like economics where safeguards have been stripped for efficiency