zbMATH — the first resource for mathematics

Smoothing parameter selection for a class of semiparametric linear models. (English) Zbl 1248.62057
Summary: Spline-based approaches to nonparametric and semiparametric regression, as well as to regression of scalar outcomes on functional predictors, entail choosing a parameter controlling the extent to which roughness of the fitted function is penalized. We demonstrate that the equations determining two popular methods for smoothing parameter selection, generalized cross-validation and restricted maximum likelihood, share a similar form that allows us to prove several results which are common to both, and to derive a condition under which they yield identical values. These ideas are illustrated by application of functional principal components regression, a method for regressing scalars on functions, to two chemometric data sets.

62G08 Nonparametric regression and quantile regression
62H25 Factor analysis and principal components; correspondence analysis
65D07 Numerical computation using splines
62J05 Linear regression; mixed models
Full Text: DOI
[1] Cantoni, Degrees-of-freedom tests for smoothing splines, Biometrika 89 pp 251– (2002) · Zbl 1019.62038
[2] Cardot, Spatially adaptive splines for statistical linear inverse problems, J. Multiv. Anal. 81 pp 100– (2002) · Zbl 1005.65053
[3] Cardot, Spline estimators for the functional linear model, Statist. Sin. 13 pp 571– (2003) · Zbl 1050.62041
[4] Cox, Testing the (parametric) null hypothesis in (semiparametric) partial and generalized spline models, Ann. Statist. 16 pp 113– (1988) · Zbl 0673.62017
[5] Crainiceanu, Likelihood ratio tests in linear mixed models with one variance component, J. R. Statist. Soc. B 66 pp 165– (2004) · Zbl 1061.62027
[6] Craven, Smoothing noisy data with spline functions: estimating the correct degree of smoothing by the method of generalized cross-validation, Numer. Math. 31 pp 377– (1979) · Zbl 0377.65007
[7] Eilers, Discussion on ’The analysis of designed experiments and longitudinal data by using smoothing splines’ (by A. P. Verbyla, B. R. Cullis, M. G. Kenward and S. J. Welham), Appl. Statist. 48 pp 307– (1999)
[8] Eilers, Generalized linear additive smooth structures, J. Computnl Graph. Statist. 11 pp 758– (2002)
[9] Green, Nonparametric Regression and Generalized Linear Models: a Roughness Penalty Approach (1994) · Zbl 0832.62032
[10] Hastie, Generalized Additive Models (1990) · Zbl 0747.62061
[11] Kalivas, Two data sets of near infrared spectra, Chemometr. Intell. Lab. Syst. 37 pp 255– (1997)
[12] Kauermann, A note on smoothing parameter selection for penalized spline smoothing, J. Statist. Planng Inf. 127 pp 53– (2005) · Zbl 1083.62036
[13] Kou, From finite sample to asymptotics: a geometric bridge for selection criteria in spline regression, Ann. Statist. 32 pp 2444– (2004) · Zbl 1076.62039
[14] Krivobokova, Fast adaptive penalized splines, J. Computnl Graph. Statist. 17 pp 1– (2008)
[15] Lee, Generalized Linear Models with Random Effects: Unified Analysis via H-likelihoood (2006) · Zbl 1110.62092
[16] Lindstrom, Newton-Raphson and EM algorithms for linear mixed-effects models for repeated-measures data, J. Am. Statist. Ass. 83 pp 1014– (1988) · Zbl 0671.65119
[17] Marx, Generalized linear regression on sampled signals and curves: a P-spline approach, Technometrics 41 pp 1– (1999)
[18] Pawitan, In All Likelihood (2001)
[19] Reiss (2006)
[20] Reiss, Functional principal component regression and functional partial least squares, J. Am. Statist. Ass. 102 pp 984– (2007) · Zbl 05564426
[21] Ruppert, Semiparametric Regression (2003) · Zbl 1038.62042
[22] Wahba, Spline Models for Observational Data (1990) · Zbl 0813.62001
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.