Abstract
In the past ten years there has been a dramatic increase of interest in the Bayesian analysis of finite mixture models. This is primarily because of the emergence of Markov chain Monte Carlo (MCMC) methods. While MCMC provides a convenient way to draw inference from complicated statistical models, there are many, perhaps underappreciated, problems associated with the MCMC analysis of mixtures. The problems are mainly caused by the nonidentifiability of the components under symmetric priors, which leads to so-called label switching in the MCMC output. This means that ergodic averages of component specific quantities will be identical and thus useless for inference. We review the solutions to the label switching problem, such as artificial identifiability constraints, relabelling algorithms and label invariant loss functions. We also review various MCMC sampling schemes that have been suggested for mixture models and discuss posterior sensitivity to prior specification.
Keywords
Markov chain Monte CarloIdentifiabilityPrior probabilityComputer scienceBayesian inferenceBayesian probabilityGibbs samplingMarkov chainAlgorithmInferenceArtificial intelligenceMathematicsMachine learning
Affiliated Institutions
Related Publications
Inference in Molecular Population Genetics
Summary Full likelihood-based inference for modern population genetics data presents methodological and computational challenges. The problem is of considerable practical import...
Dealing With Label Switching in Mixture Models
Summary In a Bayesian analysis of finite mixture models, parameter estimation and clustering are sometimes less straightforward than might be expected. In particular, the common...
A comparison of Bayesian and likelihood-based methods for fitting multilevel models
We use simulation studies, whose design is realistic for educational and medical\nresearch (as well as other fields of inquiry), to compare Bayesian and likelihood-based\nmethod...
Latent Class Model Diagnosis
Summary. In many areas of medical research, such as psychiatry and gerontology, latent class variables are used to classify individuals into disease categories, often with the i...
dynesty: a dynamic nested sampling package for estimating Bayesian posteriors and evidences
ABSTRACT We present dynesty, a public, open-source, python package to estimate Bayesian posteriors and evidences (marginal likelihoods) using the dynamic nested sampling methods...
Publication Info
- Year
- 2005
- Type
- article
- Volume
- 20
- Issue
- 1
- Citations
- 671
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
671
OpenAlex
Cite This
Ajay Jasra,
Chris Holmes,
David A. Stephens
(2005).
Markov Chain Monte Carlo Methods and the Label Switching Problem in Bayesian Mixture Modeling.
Statistical Science
, 20
(1)
.
https://doi.org/10.1214/088342305000000016
Identifiers
- DOI
- 10.1214/088342305000000016