Abstract
Adjustments for making multiple comparisons in large bodies of data are recommended to avoid rejecting the null hypothesis too readily. Unfortunately, reducing the type I error for null associations increases the type II error for those associations that are not null. The theoretical basis for advocating a routine adjustment for multiple comparisons is the "universal null hypothesis" that "chance" serves as the first-order explanation for observed phenomena. This hypothesis undermines the basic premises of empirical research, which holds that nature follows regular laws that may be studied through observations. A policy of not making adjustments for multiple comparisons is preferable because it will lead to fewer errors of interpretation when the data under evaluation are not random numbers but actual observations on nature. Furthermore, scientists should not be so reluctant to explore leads that may turn out to be wrong that they penalize themselves by missing possibly important findings.
Keywords
Null hypothesisNull (SQL)Type I and type II errorsAlternative hypothesisEconometricsInterpretation (philosophy)Multiple comparisons problemStatistical hypothesis testingOrder (exchange)StatisticsMathematicsComputer scienceEconomicsData mining
Related Publications
Why We (Usually) Don't Have to Worry About Multiple Comparisons
Applied researchers often find themselves making statistical inferences in settings that would seem to require multiple comparisons adjustments. We challenge the Type I error pa...
Information theory and hypothesis testing: a call for pluralism
Summary A major paradigm shift is occurring in the approach of ecologists to statistical analysis. The use of the traditional approach of null‐hypothesis testing has been questi...
Methods to account for spatial autocorrelation in the analysis of species distributional data: a review
Species distributional or trait data based on range map (extent‐of‐occurrence) or atlas survey data often display spatial autocorrelation, i.e. locations close to each other exh...
MARCS model atmospheres
In this review presented at the Symposium A stellar journey in Uppsala, June 2008, I give my account of the historical development of the MARCS code from the first version publi...
A Direct Approach to False Discovery Rates
Summary Multiple-hypothesis testing involves guarding against much more complicated errors than single-hypothesis testing. Whereas we typically control the type I error rate for...
Publication Info
- Year
- 1990
- Type
- article
- Volume
- 1
- Issue
- 1
- Pages
- 43-46
- Citations
- 5534
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
5534
OpenAlex
Cite This
Kenneth J. Rothman
(1990).
No Adjustments Are Needed for Multiple Comparisons.
Epidemiology
, 1
(1)
, 43-46.
https://doi.org/10.1097/00001648-199001000-00010
Identifiers
- DOI
- 10.1097/00001648-199001000-00010