Abstract
We propose penalized likelihood methods for estimating the concentration matrix in the Gaussian graphical model. The methods lead to a sparse and shrinkage estimator of the concentration matrix that is positive definite, and thus conduct model selection and estimation simultaneously. The implementation of the methods is nontrivial because of the positive definite constraint on the concentration matrix, but we show that the computation can be done effectively by taking advantage of the efficient maxdet algorithm developed in convex optimization. We propose a <scp>BIC</scp>-type criterion for the selection of the tuning parameter in the penalized likelihood methods. The connection between our methods and existing methods is illustrated. Simulations and real examples demonstrate the competitive performance of the new methods.
Keywords
MathematicsMathematical optimizationSelection (genetic algorithm)Model selectionComputationGaussianMatrix (chemical analysis)EstimatorPositive-definite matrixAlgorithmGraphical modelConstraint (computer-aided design)Computer scienceStatisticsArtificial intelligence
Affiliated Institutions
Related Publications
Nonconcave penalized likelihood with a diverging number of parameters
A class of variable selection procedures for parametric models via nonconcave penalized likelihood was proposed by Fan and Li to simultaneously estimate parameters and select im...
Accounting for Uncertainty in the Tree Topology Has Little Effect on the Decision-Theoretic Approach to Model Selection in Phylogeny Estimation
Currently available methods for model selection used in phylogenetic analysis are based on an initial fixed-tree topology. Once a model is picked based on this topology, a rigor...
Robust Improper Maximum Likelihood: Tuning, Computation, and a Comparison With Other Methods for Robust Gaussian Clustering
The two main topics of this paper are the introduction of the "optimally\ntuned improper maximum likelihood estimator" (OTRIMLE) for robust clustering\nbased on the multivariate...
Orthogonal least squares methods and their application to non-linear system identification
Identification algorithms based on the well-known linear least squares methods of<br/>gaussian elimination, Cholesky decomposition, classical Gram-Schmidt, modified<br/...
Variable selection using MM algorithms
Variable selection is fundamental to high-dimensional statistical modeling. Many variable selection techniques may be implemented by maximum penalized likelihood using various p...
Publication Info
- Year
- 2007
- Type
- article
- Volume
- 94
- Issue
- 1
- Pages
- 19-35
- Citations
- 1672
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
1672
OpenAlex
Cite This
Ming Yuan,
Yi Lin
(2007).
Model selection and estimation in the Gaussian graphical model.
Biometrika
, 94
(1)
, 19-35.
https://doi.org/10.1093/biomet/asm018
Identifiers
- DOI
- 10.1093/biomet/asm018