Abstract
Summary Many different methods have been proposed to construct nonparametric estimates of a smooth regression function, including local polynomial, (convolution) kernel and smoothing spline estimators. Each of these estimators uses a smoothing parameter to control the amount of smoothing performed on a given data set. In this paper an improved version of a criterion based on the Akaike information criterion (AIC), termed AICC, is derived and examined as a way to choose the smoothing parameter. Unlike plug-in methods, AICC can be used to choose smoothing parameters for any linear smoother, including local quadratic and smoothing spline estimators. The use of AICC avoids the large variability and tendency to undersmooth (compared with the actual minimizer of average squared error) seen when other ‘classical’ approaches (such as generalized cross-validation (GCV) or the AIC) are used to choose the smoothing parameter. Monte Carlo simulations demonstrate that the AICC-based smoothing parameter is competitive with a plug-in method (assuming that one exists) when the plug-in method works well but also performs well when the plug-in approach fails or is unavailable.
Keywords
Akaike information criterionSmoothingEstimatorSmoothing splineMathematicsSpline (mechanical)Model selectionNonparametric regressionKernel smootherMathematical optimizationNonparametric statisticsStatisticsApplied mathematicsComputer scienceKernel methodSupport vector machineSpline interpolationArtificial intelligenceEngineering
Affiliated Institutions
Related Publications
The Performance of Cross-Validation and Maximum Likelihood Estimators of Spline Smoothing Parameters
Abstract An important aspect of nonparametric regression by spline smoothing is the estimation of the smoothing parameter. In this article we report on an extensive simulation s...
Fast Stable Restricted Maximum Likelihood and Marginal Likelihood Estimation of Semiparametric Generalized Linear Models
Summary Recent work by Reiss and Ogden provides a theoretical basis for sometimes preferring restricted maximum likelihood (REML) to generalized cross-validation (GCV) for smoot...
Empirical Functionals and Efficient Smoothing Parameter Selection
SUMMARY A striking feature of curve estimation is that the smoothing parameter ĥ 0, which minimizes the squared error of a kernel or smoothing spline estimator, is very difficul...
Regression and time series model selection in small samples
A bias correction to the Akaike information criterion, AIC, is derived for regression and autoregressive time series models. The correction is of particular use when the sample ...
Spline Smoothing: The Equivalent Variable Kernel Method
The spline smoothing approach to nonparametric regression and curve estimation is considered. It is shown that, in a certain sense, spline smoothing corresponds approximately to...
Publication Info
- Year
- 1998
- Type
- article
- Volume
- 60
- Issue
- 2
- Pages
- 271-293
- Citations
- 1236
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
1236
OpenAlex
Cite This
Clifford M. Hurvich,
Jeffrey S. Simonoff,
Chih‐Ling Tsai
(1998).
Smoothing Parameter Selection in Nonparametric Regression Using an Improved Akaike Information Criterion.
Journal of the Royal Statistical Society Series B (Statistical Methodology)
, 60
(2)
, 271-293.
https://doi.org/10.1111/1467-9868.00125
Identifiers
- DOI
- 10.1111/1467-9868.00125