Abstract
The standardized group mean difference, Cohen’s d, is among the most commonly used and intuitively appealing effect sizes for group comparisons. However, reporting this point estimate alone does not reflect the extent to which sampling error may have led to an obtained value. A confidence interval expresses the uncertainty that exists between d and the population value, δ, it represents. A set of Monte Carlo simulations was conducted to examine the integrity of a noncentral approach analogous to that given by Steiger and Fouladi, as well as two bootstrap approaches in situations in which the normality assumption is violated. Because d is positively biased, a procedure given by Hedges and Olkin is outlined, such that an unbiased estimate of δ can be obtained. The bias-corrected and accelerated bootstrap confidence interval using the unbiased estimate of δ is proposed and recommended for general use, especially in cases in which the assumption of normality may be violated.
Keywords
StatisticsConfidence intervalMathematicsPoint estimationRobust confidence intervalsNormalityParametric statisticsMonte Carlo methodPopulationCoverage probabilityEconometricsNominal levelMean differenceMedicine
Affiliated Institutions
Related Publications
The Jackknife, the Bootstrap and Other Resampling Plans
The Jackknife Estimate of Bias The Jackknife Estimate of Variance Bias of the Jackknife Variance Estimate The Bootstrap The Infinitesimal Jackknife The Delta Method and the Infl...
CONFIDENCE LIMITS ON PHYLOGENIES: AN APPROACH USING THE BOOTSTRAP
The recently-developed statistical method known as the "bootstrap" can be used to place confidence intervals on phylogenies. It involves resampling points from one's own data, w...
How Much Should We Trust Differences-In-Differences Estimates?
Most papers that employ Differences-in-Differences estimation (DD) use many years of data and focus on serially correlated outcomes but ignore that the resulting standard errors...
Effect size, confidence interval and statistical significance: a practical guide for biologists
Abstract Null hypothesis significance testing (NHST) is the dominant statistical approach in biology, although it has many, frequently unappreciated, problems. Most importantly,...
Treatment-effect estimates adjusted for small-study effects via a limit meta-analysis
Statistical heterogeneity and small-study effects are 2 major issues affecting the validity of meta-analysis. In this article, we introduce the concept of a limit meta-analysis,...
Publication Info
- Year
- 2004
- Type
- article
- Volume
- 65
- Issue
- 1
- Pages
- 51-69
- Citations
- 176
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
176
OpenAlex
18
Influential
144
CrossRef
Cite This
Ken Kelley
(2004).
The Effects of Nonnormal Distributions on Confidence Intervals Around the Standardized Mean Difference: Bootstrap and Parametric Confidence Intervals.
Educational and Psychological Measurement
, 65
(1)
, 51-69.
https://doi.org/10.1177/0013164404264850
Identifiers
- DOI
- 10.1177/0013164404264850