Abstract
In multiple regression it is shown that parameter estimates based on minimum residual sum of squares have a high probability of being unsatisfactory, if not incorrect, if the prediction vectors are not orthogonal. Proposed is an estimation procedure based on adding small positive quantities to the diagonal of X′X. Introduced is the ridge trace, a method for showing in two dimensions the effects of nonorthogonality. It is then shown how to augment X′X to obtain biased estimates with smaller mean square error.
Keywords
RidgeResidualMathematicsDiagonalRegressionStatisticsLeast-squares function approximationTRACE (psycholinguistics)Applied mathematicsAlgorithmGeometryGeology
Affiliated Institutions
Related Publications
Ridge Regression: Biased Estimation for Nonorthogonal Problems
In multiple regression it is shown that parameter estimates based on minimum residual sum of squares have a high probability of being unsatisfactory, if not incorrect, if the pr...
Ridge Regression: Applications to Nonorthogonal Problems
Abstract This paper is an exposition of the use of ridge regression methods. Two examples from the literature are used as a base. Attention is focused on the RIDGE TRACE which i...
Classical F-Tests and Confidence Regions for Ridge Regression
For testing general linear hypotheses in multiple regression models. it is shown that non-stochastically shrunken ridge estimators yield the same central F-ratios and t-statisti...
Regression Shrinkage and Selection Via the Lasso
SUMMARY We propose a new method for estimation in linear models. The ‘lasso’ minimizes the residual sum of squares subject to the sum of the absolute value of the coefficients b...
Subset Selection in Regression
OBJECTIVES Prediction, Explanation, Elimination or What? How Many Variables in the Prediction Formula? Alternatives to Using Subsets 'Black Box' Use of Best-Subsets Techniques L...
Publication Info
- Year
- 2000
- Type
- article
- Volume
- 42
- Issue
- 1
- Pages
- 80-80
- Citations
- 6560
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
6560
OpenAlex
Cite This
Arthur E. Hoerl,
Robert W. Kennard
(2000).
Ridge Regression: Biased Estimation for Nonorthogonal Problems.
Technometrics
, 42
(1)
, 80-80.
https://doi.org/10.2307/1271436
Identifiers
- DOI
- 10.2307/1271436