Wavelet penalized likelihood estimation in generalized functional models. (English) Zbl 1259.62017

Gannaz, Irène

Test 22, No. 1, 122-158 (2013).

Summary: This paper deals with generalized functional regression. The aim is to estimate the influence of covariates on observations, drawn from an exponential distribution. The link considered has a semiparametric expression: if we are interested in a functional influence of some covariates, we authorize others to be modeled linearly. We thus consider a generalized partially linear regression model with unknown regression coefficients and an unknown nonparametric function. We present a maximum penalized likelihood procedure to estimate the components of the model introducing penalty based wavelet estimators. Asymptotic rates of the estimates of both the parametric and the nonparametric part of the model are given and quasi-minimax optimality is obtained under usual conditions in the literature. We establish in particular that the \(\ell^1\)-penalty leads to an adaptive estimation with respect to the regularity of the estimated function. An algorithm based on backfitting and Fisher-scoring is also proposed for implementation. Simulations are used to illustrate the finite sample behavior, including a comparison with kernel- and spline-based methods.

MSC:

62G08	Nonparametric regression and quantile regression
65T60	Numerical methods for wavelets
62J05	Linear regression; mixed models
62G20	Asymptotic properties of nonparametric inference
65C60	Computational problems in statistics (MSC2010)

Keywords:

generalized partially linear regression; semiparametric models; M-estimation; penalized loglikelihood estimation; wavelet thresholding

Software:

Fahrmeir; KernGPLM; wavelets

References:

[1]	Aldrich E (2010) Wavelets: a package of functions for computing wavelet filters, wavelet transforms and multiresolution analyses. http://CRAN.R-project.org/package=wavelets , R package version 0.2-6
[2]	Antoniadis A (1996) Smoothing noisy data with tapered coiflets series. Scand J Stat 23(3):313–330 · Zbl 0861.62028
[3]	Antoniadis A, Fan J (2001) Regularization of wavelet approximations. J Am Stat Assoc 96(455):939–967 · Zbl 1072.62561
[4]	Antoniadis A, Sapatinas T (2001) Wavelet shrinkage for natural exponential families with quadratic variance functions. Biometrika 88:805–820 · Zbl 0985.62021
[5]	Antoniadis A, Besbeas P, Sapatinas T (2001) Wavelet shrinkage for natural exponential families with cubic variance functions. Sankhya Indian J Stat 363(3):309–327 · Zbl 1192.62112
[6]	Antoniadis A, Gijbels I, Nikolova M (2011) Penalized likelihood regression for generalized linear models with nonquadratic penalties. Ann Inst Stat Math 63(3):585–615 · Zbl 1333.62113
[7]	Bai Z, Rao C, Wu Y (1992) M-estimation of multivariate linear regression parameters under a convex discrepancy function. Stat Sin 2:237–254 · Zbl 0820.62048
[8]	Birgé L, Massart P (2000) An adaptive compression algorithm in Besov spaces. Constr Approx 16:1–36 · Zbl 1004.41006
[9]	Boente G, He X, Zhou J (2006) Robust estimates in generalized partially linear models. Ann Stat 34(6):2856–2878 · Zbl 1114.62032
[10]	Brown L, Cai T, Zhou H (2010) Nonparametric regression in exponential families. Ann Stat 38(4):2005–2046 · Zbl 1202.62050
[11]	Chang XW, Qu L (2004) Wavelet estimation of partially linear models. Comput Stat Data Anal 47(1):31–48 · Zbl 1429.62122
[12]	Chen H (1987) Estimation of semiparametric generalized linear models. Tech rep, State University of New, York
[13]	Craven P, Wahba G (1979) Smoothing noisy data with spline functions: estimating the correct degree of smoothing by the method of generalized cross-validation. Numer Math 31:377–403 · Zbl 0377.65007
[14]	Daubechies I (1992) Ten lectures on wavelets, vol 61. SIAM, Philadelphia · Zbl 0776.42018
[15]	Donoho D, Johnstone I (1994) Ideal spatial adaptation by wavelet shrinkage. Biometrika 81(3):425–455 · Zbl 0815.62019
[16]	Donoho D, Johnstone I (1995) Adapting to unknown smoothness via wavelet shrinkage. J Am Stat Assoc 90(432):1200–1224 · Zbl 0869.62024
[17]	Donoho D, Johnstone I (1998) Minimax estimation via wavelet shrinkage. Ann Stat 26(3):879–921 · Zbl 0935.62041
[18]	Donoho D, Johnstone I, Kerkyacharian G, Picard D (1995) Wavelet shrinkage: asymptotia? J R Stat Soc 57(2):301–369 · Zbl 0827.62035
[19]	Fadili J, Bullmore E (2005) Penalized partially linear models using sparse representation with an application to fMRI time series. IEEE Trans Signal Process 53(9):3436–3448 · Zbl 1373.62342
[20]	Fahrmeir L, Tutz G (1994) Multivariate statistical modelling based on generalized linear models. Springer, Berlin · Zbl 0809.62064
[21]	Fan J, Li R (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. J Am Stat Assoc 96(456):1348–1360 · Zbl 1073.62547
[22]	Gannaz I (2007a) Estimation par ondelettes dans les modèles partiellement linéaires. PhD thesis, Université Grenoble 1
[23]	Gannaz I (2007b) Robust estimation and wavelet thresholding in partially linear models. Stat Comput 4(17):293–310
[24]	Härdle W, Kerkyacharian G, Picard D, Tsybakov A (1998a) Wavelets approximation and statistical applications. Lecture notes in statistics, vol 129. Springer, Berlin · Zbl 0899.62002
[25]	Härdle W, Mammen E, Müller M (1998b) Testing parametric versus semiparametric modelling in generalized linear models. J Am Stat Assoc 93:1461–1474 · Zbl 1064.62543
[26]	Hastie T, Tibshirani R (1990) Generalized additive models. Chapman and Hall, London · Zbl 0747.62061
[27]	Jansen M, Malfait M, Bultheel A (1997) Generalized cross validation for wavelet thresholding. Signal Process 1:33–44 · Zbl 0892.94002
[28]	Loubes J, Van der Geer S (2002) Adaptative estimation with soft thresholding type penalties. Stat Neerl 56(4):454–479 · Zbl 1090.62534
[29]	Mallat S (1989) A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans Pattern Anal Mach Intell 11(7):674–693 · Zbl 0709.94650
[30]	Mallat S (1999) A wavelet tour on signal processing, 2nd edn. Academic Press, San Diego · Zbl 0998.94510
[31]	Mammen E, Van der Geer S (1997) Penalized quasi-likelihood estimation in partial linear models. Ann Stat 25(3):1014–1035 · Zbl 0906.62033
[32]	McCullagh P, Nelder J (1989) Generalized linear models, 2nd edn. Chapman and Hall, London · Zbl 0744.62098
[33]	Meyer Y (1992) Wavelets and operators. Cambridge University Press, Cambridge · Zbl 0776.42019
[34]	Meyer F (2003) Wavelet-based estimation of a semiparametric generalized linear model of fMRI time-series. IEEE Trans Med Imaging 22:315–324
[35]	Müller M (2001) Estimating and testing in generalized partial linear models–a comparative study. Stat Comput 11:299–309
[36]	Müller M (2009) KernGPLM: Kernel-based GPLM and GAM. R package version 0.65
[37]	O’Sullivan F, Yandell B, Raynor W (1986) Automatic smoothing of regression functions in generalized linear models. J Am Stat Assoc 81(393):96–103
[38]	Reynaud-Bouret P, Rivoirard V (2010) Near optimal thresholding estimation of a Poisson intensity on the real line. Electron J Stat 4:172–238 · Zbl 1329.62176
[39]	Rice J (1986) Convergence rates for partially splined models. Stat Probab Lett 4:203–208 · Zbl 0628.62077
[40]	Rockafellar R (1970) Convex analysis. Princeton University Press, Princeton · Zbl 0193.18401
[41]	Sardy S, Antoniadis A, Tseng P (2004) Automatic smoothing with wavelets. J Comput Graph Stat 13(2):1–23
[42]	Severini T, Staniswalis J (1994) Quasi-likelihood estimation in semiparametric models. J Am Stat Assoc 89:501–511 · Zbl 0798.62046
[43]	Severini T, Wong W (1992) Profile likelihood and conditionally parametric models. Ann Stat 20(4):1768–1802 · Zbl 0768.62015
[44]	Speckman P (1988) Kernel smoothing in partial linear models. J R Stat Soc B 50(3):413–436 · Zbl 0671.62045
[45]	Tibshirani RJ (1996) Regression shrinkage and selection via the LASSO. J R Stat Soc Ser B 58:267–288 · Zbl 0850.62538
[46]	Van der Geer S (2000) Empirical processes in M-estimation. Cambridge University Press, Cambridge
[47]	Wang L, Brown L, Cai T (2011) A difference based approach to the semiparametric partial linear model. Electron J Stat 5:619–641 · Zbl 1329.62179