Abstract

Summary Between-study heterogeneity and publication bias are common features of a meta-analysis that can be present simultaneously. When both are suspected, consideration must be made of each in the assessment of the other. We consider extended funnel plot tests for detecting publication bias, and selection modelling and trim-and-fill methods to adjust for publication bias in the presence of between-study heterogeneity. These methods are applied to two example data sets. Results indicate that ignoring between-study heterogeneity when assessing publication bias can be misleading, but that methods to test or adjust for publication bias in the presence of heterogeneity may not be powerful when the meta-analysis is not large. It is therefore unrealistic to expect to disentangle the effects of publication bias and heterogeneity reliably in all except the largest meta-analyses.

Keywords

Publication biasFunnel plotMeta-analysisSelection biasEconometricsStudy heterogeneityStatisticsSampling biasInformation biasSelection (genetic algorithm)Computer scienceSample size determinationMathematicsConfidence intervalMedicineArtificial intelligence

Affiliated Institutions

Related Publications

Publication Info

Year
2010
Type
article
Volume
173
Issue
3
Pages
575-591
Citations
166
Access
Closed

External Links

Social Impact

Social media, news, blog, policy document mentions

Citation Metrics

166
OpenAlex

Cite This

Jaime Peters, Alex J. Sutton, David R. Jones et al. (2010). Assessing Publication Bias in Meta-Analyses in the Presence of Between-Study Heterogeneity. Journal of the Royal Statistical Society Series A (Statistics in Society) , 173 (3) , 575-591. https://doi.org/10.1111/j.1467-985x.2009.00629.x

Identifiers

DOI
10.1111/j.1467-985x.2009.00629.x