Abstract
Summary We propose the elastic net, a new regularization and variable selection method. Real world data and a simulation study show that the elastic net often outperforms the lasso, while enjoying a similar sparsity of representation. In addition, the elastic net encourages a grouping effect, where strongly correlated predictors tend to be in or out of the model together. The elastic net is particularly useful when the number of predictors (p) is much bigger than the number of observations (n). By contrast, the lasso is not a very satisfactory variable selection method in the p≫n case. An algorithm called LARS-EN is proposed for computing elastic net regularization paths efficiently, much like algorithm LARS does for the lasso.
Keywords
Elastic net regularizationRegularization (linguistics)Feature selectionVariable (mathematics)Computer scienceMathematicsApplied mathematicsMathematical optimizationAlgorithmArtificial intelligenceMathematical analysis
Affiliated Institutions
Related Publications
Least angle regression
The purpose of model selection algorithms such as All Subsets, Forward Selection and Backward Elimination is to choose a linear model on the basis of the same set of data to whi...
Simultaneous Regression Shrinkage, Variable Selection, and Supervised Clustering of Predictors with OSCAR
Summary Variable selection can be challenging, particularly in situations with a large number of predictors with possibly high correlations, such as gene expression data. In thi...
The Adaptive Lasso and Its Oracle Properties
The lasso is a popular technique for simultaneous estimation and variable selection. Lasso variable selection has been shown to be consistent under certain conditions. In this w...
A NOTE ON THE LASSO AND RELATED PROCEDURES IN MODEL SELECTION
The Lasso, the Forward Stagewise regression and the Lars are closely re-lated procedures recently proposed for linear regression problems. Each of them can produce sparse models...
On Model Selection Consistency of Lasso
Sparsity or parsimony of statistical models is crucial for their proper interpretations, as in sciences and social sciences. Model selection is a commonly used method to find su...
Publication Info
- Year
- 2005
- Type
- article
- Volume
- 67
- Issue
- 2
- Pages
- 301-320
- Citations
- 19682
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
19682
OpenAlex
Cite This
Hui Zou,
Trevor Hastie
(2005).
Regularization and Variable Selection Via the Elastic Net.
Journal of the Royal Statistical Society Series B (Statistical Methodology)
, 67
(2)
, 301-320.
https://doi.org/10.1111/j.1467-9868.2005.00503.x
Identifiers
- DOI
- 10.1111/j.1467-9868.2005.00503.x