zbMATH — the first resource for mathematics

Smoothed nonparametric derivative estimation using weighted difference quotients. (English) Zbl 07255096
Summary: Derivatives play an important role in bandwidth selection methods (e.g., plug-ins), data analysis and bias-corrected confidence intervals. Therefore, obtaining accurate derivative information is crucial. Although many derivative estimation methods exist, the majority require a fixed design assumption. In this paper, we propose an effective and fully data-driven framework to estimate the first and second order derivative in random design. We establish the asymptotic properties of the proposed derivative estimator, and also propose a fast selection method for the tuning parameters. The performance and flexibility of the method is illustrated via an extensive simulation study.
68T05 Learning and adaptive systems in artificial intelligence
kedd; ks; locpol; pspline
Full Text: Link
[1] C.G. Arsalane.Package ‘kedd’.https://cran.r-project.org/web/packages/kedd/ kedd.pdf, October 2015.
[2] G. Casella and R.L. Berger.Statistical Inference. Duxbury advanced series in statistics and decision sciences. Thomson Learning, 2002. ISBN 9780534243128. URLhttps: //books.google.com/books?id=0x_vAAAAMAAJ.
[3] Smoothed Nonparametric Derivative Estimation using Weighted Difference Quotients
[4] R. Charnigo, B. Hall, and C. Srinivasan. A generalized c p criterion for derivative estimation. Technometrics, 53(3):238-253, 2011.
[5] P. Chaudhuri and J.S. Marron. Sizer for exploration of structures in curves.Journal of the American Statistical Association, 94(447):807-823, 1999.
[6] N.A.C. Cressie.Statistics for Spatial Data, 2nd Ed.Wiley, New York, 1993.
[7] W. Dai, T. Tong, and M.G. Genton. Optimal estimation of derivatives in nonparametric regression.Journal of Machine Learning Research, 17(164):1-25, 2016.
[8] H.A. David and H.N. Nagaraja.Order statistics. Wiley Online Library, 1970.
[9] K. De Brabanter, J. De Brabanter, B. De Moor, and I. Gijbels. Derivative estimation with local polynomial fitting.The Journal of Machine Learning Research, 14(1):281-301, 2013.
[10] K. De Brabanter, C. Fan, I. Gijbels, and J. Opsomer. Local polynomial regression with correlated errors in random design and unknown correlation structure.Biometrika, 105 (3):681-690, 2018.
[11] M Delecroix and A.C. Rosa. Nonparametric estimation of a regression function and its derivatives under an ergodic hypothesis.Journal of Nonparametric Statistics, 6(4):367- 382, 1996.
[12] T Duong. Kernel smoothing.https://cran.r-project.org/web/packages/ks/index. html, 2018. [Online; accessed 22-April-2018].
[13] R.L. Eubank and P.L. Speckman. Confidence bands in nonparametric regression.Journal of the American Statistical Association, 88(424):1287-1301, 1993.
[14] J. Fan and I. Gijbels.Local polynomial modelling and its applications: monographs on statistics and applied probability 66, volume 66. CRC Press, 1996.
[15] M. Francisco-Fern´andez, J. Opsomer, and J.M. Vilar-Fern´andez. Plug-in bandwidth selector for local polynomial regression estimator with correlated errors.Nonparametric Statistics, 16(1-2):127-151, 2004.
[16] I. Gijbels and A-C Goderniaux. Data-driven discontinuity detection in derivatives of a regression function.Communications in Statistics-Theory and Methods, 33(4):851-871, 2005.
[17] L. Gy¨orfi, M. Kohler, A. Krzyzak, and H. Walk.A distribution-free theory of nonparametric regression. Springer Science & Business Media, 2006.
[18] P. Hall, J.W. Kay, and D.M. Titterinton. Asymptotically optimal difference-based estimation of variance in nonparametric regression.Biometrika, 77(3):521-528, 1990.
[19] W. H¨ardle.Applied nonparametric regression. Cambridge university press, 1990.
[20] B. Hassibi and D.G. Stork. Second order derivatives for network pruning: Optimal brain surgeon. InAdvances in neural information processing systems, pages 164-171, 1993.
[21] A. Iserles.A first course in the numerical analysis of differential equations. Cambridge university press, 2009.
[22] Y. Liu and K. De Brabanter.Derivative estimation in random design.In S. Bengio,H. Wallach,H. Larochelle,K. Grauman,N. Cesa-Bianchi,and R. Garnett,editors,AdvancesinNeuralInformationProcessingSystems31,pages 3449-3458. Curran Associates, Inc., 2018.URLhttp://papers.nips.cc/paper/ 7604-derivative-estimation-in-random-design.pdf.
[23] A. Meister.Deconvolution Problems in Nonparametric Statistics. Springer, 2009.
[24] H-G M¨uller.Nonparametric regression analysis of longitudinal data, volume 46. Springer Science & Business Media, 2012.
[25] H-G M¨uller, U. Stadtm¨uller, and T. Schmitt. Bandwidth choice and confidence intervals for derivatives of noisy data.Biometrika, 74(4):743-749, 1987.
[26] C.J.L. Ojeda. locpol: Kernel local polynomial regression.https://cran.r-project.org/ web/packages/locpol/index.html, 2012. [Online; accessed 22-April-2018].
[27] J. Opsomer, Y. Wang, and Y. Yang. Nonparametric regression with correlated errors. Statistical Science, pages 134-153, 2001.
[28] C. Park and K-H. Kang. Sizer analysis for the comparison of regression curves.Computational Statistics & Data Analysis, 52(8):3954-3970, 2008.
[29] E. Parzen. On estimation of a probability density function and mode.The Annals of Mathematical Statistics, 33(3):1065-1076, 1962.
[30] J. Ramsay. derivative estimation.StatLib -S-News, 1998.
[31] J.O. Ramsay and B.W. Silverman.Applied functional data analysis: methods and case studies. Springer, 2007.
[32] J. Ramsey and B. Ripley. pspline: Penalized smoothing splines.https://cran.r-project. org/web/packages/pspline/index.html, 2017. [Online; accessed 22-April-2018].
[33] J.A. Rice. Bandwidth choice for differentiation.Journal of Multivariate Analysis, 19(2): 251-264, 1986.
[34] V. Rondonotti, J.S. Marron, and C. Park. Sizer for time series: a new approach to the analysis of trends.Electronic Journal of Statistics, 1:268-289, 2007.
[35] M. Rosenblatt. Remarks on some nonparametric estimates of a density function.The Annals of Mathematical Statistics, pages 832-837, 1956.
[36] C.J. Stone. Additive regression and other nonparametric models.The annals of Statistics, pages 689-705, 1985.
[37] A.B. Tsybakov.Introduction to Nonparametric Estimation. Springer Publishing Company, Incorporated, 2008.
[38] Smoothed Nonparametric Derivative Estimation using Weighted Difference Quotients
[39] G. Wahba and Y. Wang. When is the optimal regularization parameter insensitive to the choice of the loss function?Communications in Statistics-Theory and Methods, 19(5): 1685-1700, 1990.
[40] M.P. Wand and M.C. Jones.Kernel smoothing. Crc Press, 1994.
[41] W. Wang and L. Lin. Derivative estimation based on difference sequence via locally weighted least squares regression.Journal of Machine Learning Research, 16:2617-2641, 2015.
[42] Y. Xia. Bias-corrected confidence bands in nonparametric regression.Journal of the Royal Statistical Society: Series B (Statistical Methodology), 60(4):797-811, 1998.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.