Abstract
SUMMARY The common approach to the multiplicity problem calls for controlling the familywise error rate (FWER). This approach, though, has faults, and we point out a few. A different approach to problems of multiple significance testing is presented. It calls for controlling the expected proportion of falsely rejected hypotheses — the false discovery rate. This error rate is equivalent to the FWER when all hypotheses are true but is smaller otherwise. Therefore, in problems where the control of the false discovery rate rather than that of the FWER is desired, there is potential for a gain in power. A simple sequential Bonferronitype procedure is proved to control the false discovery rate for independent test statistics, and a simulation study shows that the gain in power is substantial. The use of the new procedure and the appropriateness of the criterion are illustrated with examples.
Keywords
False discovery rateMultiple comparisons problemWord error rateComputer scienceStatistical hypothesis testingStatisticsControl (management)MathematicsArtificial intelligence
Affiliated Institutions
Related Publications
The control of the false discovery rate in multiple testing under dependency
Benjamini and Hochberg suggest that the false discovery rate may\nbe the appropriate error rate to control in many applied multiple testing\nproblems. A simple procedure was giv...
On the Adaptive Control of the False Discovery Rate in Multiple Testing With Independent Statistics
A new approach to problems of multiple significance testing was presented in Benjamini and Hochberg (1995), which calls for controlling the expected ratio of the number of erron...
Multiple Hypotheses Testing with Weights
In this paper we offer a multiplicity of approaches and procedures for multiple testing problems with weights. Some rationale for incorporating weights in multiple hypotheses te...
A Direct Approach to False Discovery Rates
Summary Multiple-hypothesis testing involves guarding against much more complicated errors than single-hypothesis testing. Whereas we typically control the type I error rate for...
A New Approach to the Problem of Multiple Comparisons in the Genetic Dissection of Complex Traits
Abstract Saturated genetic marker maps are being used to map individual genes affecting quantitative traits. Controlling the “experimentwise” type-I error severely lowers power ...
Publication Info
- Year
- 1995
- Type
- article
- Volume
- 57
- Issue
- 1
- Pages
- 289-300
- Citations
- 103590
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
103590
OpenAlex
Cite This
Yoav Benjamini,
Yosef Hochberg
(1995).
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing.
Journal of the Royal Statistical Society Series B (Statistical Methodology)
, 57
(1)
, 289-300.
https://doi.org/10.1111/j.2517-6161.1995.tb02031.x
Identifiers
- DOI
- 10.1111/j.2517-6161.1995.tb02031.x