Abstract
B-splines are attractive for nonparametric modelling, but choosing the optimal number and positions of knots is a complex task. Equidistant knots can be used, but their small and discrete number allows only limited control over smoothness and fit. We propose to use a relatively large number of knots and a difference penalty on coefficients of adjacent B-splines. We show connections to the familiar spline penalty on the integral of the squared second derivative. A short overview of B-splines, of their construction and of penalized likelihood is presented. We discuss properties of penalized B-splines and propose various criteria for the choice of an optimal penalty parameter. Nonparametric logistic regression, density estimation and scatterplot smoothing are used as examples. Some details of the computations are presented.
Keywords
MathematicsSmoothingNonparametric statisticsEquidistantSmoothnessSmoothing splineComputationMathematical optimizationSpline (mechanical)Applied mathematicsNonparametric regressionB-splinePenalty methodAlgorithmStatisticsSpline interpolationMathematical analysisGeometry
Affiliated Institutions
Related Publications
Theory for penalised spline regression
Penalised spline regression is a popular new approach to smoothing, but its theoretical properties are not yet well understood. In this paper, mean squared error expressions and...
Component selection and smoothing in multivariate nonparametric regression
We propose a new method for model selection and model fitting in multivariate nonparametric regression models, in the framework of smoothing spline ANOVA. The “COSSO ” is a meth...
Generalized Linear Additive Smooth Structures
This article proposes a practical modeling approach that can accommodate a rich variety of predictors, united in a generalized linear model (GLM) setting. In addition to the usu...
Spline Smoothing in Regression Models and Asymptotic Efficiency in $L_2$
For nonparametric regression estimation on a bounded interval, optimal rates of decrease for integrated mean square error are known but not the best possible constants. A sharp ...
The Performance of Cross-Validation and Maximum Likelihood Estimators of Spline Smoothing Parameters
Abstract An important aspect of nonparametric regression by spline smoothing is the estimation of the smoothing parameter. In this article we report on an extensive simulation s...
Publication Info
- Year
- 1996
- Type
- article
- Volume
- 11
- Issue
- 2
- Citations
- 3564
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
3564
OpenAlex
Cite This
Paul H.C. Eilers,
Brian D. Marx
(1996).
Flexible smoothing with B-splines and penalties.
Statistical Science
, 11
(2)
.
https://doi.org/10.1214/ss/1038425655
Identifiers
- DOI
- 10.1214/ss/1038425655