Multiple Testing

Inference, estimation, and decision-making from data

Run one test at α = 0.05 and you have a 5% chance of a false positive. Run twenty independent tests and, even if nothing is real, you'll probably get at least one "significant" result by pure luck. This is the multiple testing problem, and it silently corrupts a huge amount of research and ML experimentation.

🔒 This is a Pro lesson — the interactive figure, worked examples, quiz and practice open with Pro access.

▶ Multiple Testing
← t-testNon-parametric Tests →