A reproducing kernel Hilbert space approach to functional linear regression. (English) Zbl 1204.62074

Summary: We study a smoothness regularization method for functional linear regression and provide a unified treatment for both the prediction and estimation problems. By developing a tool on simultaneous diagonalization of two positive definite kernels, we obtain shaper results on the minimax rates of convergence and show that smoothness regularized estimators achieve the optimal rates of convergence for both prediction and estimation under conditions weaker than those for the functional principal components based methods developed in the literature. Despite the generality of the method of regularization, we show that the procedure is easily implementable. Numerical results are obtained to illustrate the merits of the method and to demonstrate the theoretical developments.


62G08 Nonparametric regression and quantile regression
62J05 Linear regression; mixed models
46N30 Applications of functional analysis in probability theory and statistics
62G20 Asymptotic properties of nonparametric inference
62H25 Factor analysis and principal components; correspondence analysis
65C60 Computational problems in statistics (MSC2010)


fda (R)
Full Text: DOI arXiv


[1] Adams, R. A. (1975). Sobolev Spaces . Academic Press, New York. · Zbl 0314.46030
[2] Cai, T. and Hall, P. (2006). Prediction in functional linear regression. Ann. Statist. 34 2159-2179. · Zbl 1106.62036 · doi:10.1214/009053606000000830
[3] Cardot, H., Ferraty, F. and Sarda, P. (2003). Spline estimators for the functional linear model. Statist. Sinica 13 571-591. · Zbl 1050.62041
[4] Cardot, H. and Sarda, P. (2005). Estimation in generalized linear models for functional data via penalized likelihood. J. Multivariate Anal. 92 24-41. · Zbl 1065.62127 · doi:10.1016/j.jmva.2003.08.008
[5] Cox, D. D. and O’Sullivan, F. (1990). Asymptotic analysis of penalized likelihood and related estimators. Ann. Statist. 18 1676-1695. · Zbl 0719.62051 · doi:10.1214/aos/1176347872
[6] Crambes, C., Kneip, A. and Sarda, P. (2009). Smoothing splines estimators for functional linear regression. Ann. Statist. 37 35-72. · Zbl 1169.62027 · doi:10.1214/07-AOS563
[7] Cucker, F. and Smale, S. (2001). On the mathematical foundations of learning. Bull. Amer. Math. Soc. 39 1-49. · Zbl 0983.68162 · doi:10.1090/S0273-0979-01-00923-5
[8] Ferraty, F. and Vieu, P. (2006). Nonparametric Functional Data Analysis: Methods, Theory, Applications and Implementations . Springer, New York. · Zbl 1119.62046 · doi:10.1007/0-387-36620-2
[9] Hall, P. and Horowitz, J. L. (2007). Methodology and convergence rates for functional linear regression. Ann. Statist. 35 70-91. · Zbl 1114.62048 · doi:10.1214/009053606000000957
[10] James, G. (2002). Generalized linear models with functional predictors. J. Roy. Statist. Soc. Ser. B 64 411-432. JSTOR: · Zbl 1090.62070 · doi:10.1111/1467-9868.00342
[11] Johannes, J. (2009). Nonparametric estimation in functional linear models with second order stationary regressors. Unpublished manuscript. Available at . · doi:10.1007/978-3-7908-2062-1_33
[12] Li, Y. and Hsing, T. (2007). On the rates of convergence in functional linear regression. J. Multivariate Anal. 98 1782-1804. · Zbl 1130.62035 · doi:10.1016/j.jmva.2006.10.004
[13] Micchelli, C. and Wahba, G. (1981). Design problems for optimal surface interpolation. In Approximation Theory and Applications (Z. Ziegler, ed.) 329-347. Academic Press, New York.
[14] Müller, H. G. and Stadtmüller, U. (2005). Generalized functional linear models. Ann. Statist. 33 774-805. · Zbl 1068.62048 · doi:10.1214/009053604000001156
[15] Ramsay, J. O. and Silverman, B. W. (2005). Functional Data Analysis , 2nd ed. Springer, New York. · Zbl 1079.62006
[16] Riesz, F. and Sz-Nagy, B. (1955). Functional Analysis . Ungar, New York. · Zbl 0070.10902
[17] Ritter, K., Wasilkowski, G. and Woźniakowski, H. (1995). Multivariate integeration and approximation for random fields satisfying Sacks-Ylvisaker conditions. Ann. Appl. Probab. 5 518-540. · Zbl 0872.62063 · doi:10.1214/aoap/1177004776
[18] Sacks, J. and Ylvisaker, D. (1966). Designs for regression problems with correlated errors. Ann. Math. Statist. 37 66-89. · Zbl 0152.17503 · doi:10.1214/aoms/1177699599
[19] Sacks, J. and Ylvisaker, D. (1968). Designs for regression problems with correlated errors; many parameters. Ann. Math. Statist. 39 49-69. · Zbl 0165.21505 · doi:10.1214/aoms/1177698504
[20] Sacks, J. and Ylvisaker, D. (1970). Designs for regression problems with correlated errors III. Ann. Math. Statist. 41 2057-2074. · Zbl 0234.62025 · doi:10.1214/aoms/1177696705
[21] Silverman, B. W. (1982). On the estimation of a probability density function by the maximum penalized likelihood method. Ann. Statist. 10 795-810. · Zbl 0492.62034 · doi:10.1214/aos/1176345872
[22] Stein, M. (1999). Statistical Interpolation of Spatial Data: Some Theory for Kriging . Springer, New York. · Zbl 0924.62100
[23] Wahba, G. (1990). Spline Models for Observational Data . SIAM, Philadelphia. · Zbl 0813.62001
[24] Yao, F., Müller, H. G. and Wang, J. L. (2005). Functional linear regression analysis for longitudinal data. Ann. Statist. 33 2873-2903. · Zbl 1084.62096 · doi:10.1214/009053605000000660
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.