Jump estimation in inverse regression. (English) Zbl 1326.62074

Summary: We consider estimation of a step function \(f\) from noisy observations of a deconvolution \(\phi \ast f\), where \(\phi\) is some bounded \(L_{1}\)-function. We use a penalized least squares estimator to reconstruct the signal \(f\) from the observations, with penalty equal to the number of jumps of the reconstruction. Asymptotically, it is possible to correctly estimate the number of jumps with probability one. Given that the number of jumps is correctly estimated, we show that for a bounded kernel \(\phi \) the corresponding estimates of the jump locations and jump heights are \(n^{-1/2}\) consistent and converge to a joint normal distribution with covariance structure depending on \(\varphi\). As special case we obtain the asymptotic distribution of the least squares estimator in multiphase regression and generalizations thereof. Finally, singular integral kernels are briefly discussed and it is shown that the \(n^{ - 1/2}\)-rate can be improved.


62G05 Nonparametric estimation
62G20 Asymptotic properties of nonparametric inference
46E22 Hilbert spaces with reproducing kernels (= (proper) functional Hilbert spaces, including de Branges-Rovnyak and other structured spaces)
Full Text: DOI arXiv Euclid


[1] Achieser, N. I. (1992)., Theory of approximation . Dover Publications Inc., New York. Translated from the Russian and with a preface by Charles J. Hyman, Reprint of the 1956 English translation. · Zbl 0072.28403
[2] Birgé, L. and Massart, P. (2007). Minimal penalties for gaussian model selection., Probab. Theory Relat. Fields 138 33-73. · Zbl 1112.62082
[3] Bissantz, N., Dümbgen, L., Holzmann, H. and Munk, A. (2007). Nonparametric confidence bands in deconvolution density estimation., J. Royal Statist. Society Ser. B. 69 483-506.
[4] Boysen, L. (2006)., Jump estimation for noisy blurred step function . Ph.D. thesis, Georg-August-Universiät Göttingen. URL http://webdoc.sub.gwdg.de/diss/2006/boysen/boysen.pdf Braess, D. (1986)., Nonlinear approximation theory , vol. 7 of Springer Series in Computational Mathematics . Springer-Verlag, Berlin. · Zbl 0656.41001
[5] Butucea, C. and Tsybakov, A. (2008a). Sharp optimality for density deconvolution with dominating bias. i., Theory Prob. and Its Appl. 52 111-128. · Zbl 1141.62021
[6] Butucea, C. and Tsybakov, A. (2008b). Sharp optimality for density deconvolution with dominating bias. ii., Theory Prob. and Its Appl. 52 237-249. · Zbl 1142.62017
[7] Carlstein, E. and Müller, H.-G. (eds.) (1994)., Change-point problems . Institute of Mathematical Statistics Lecture Notes-Monograph Series, 23, Institute of Mathematical Statistics, Hayward, CA. Papers from the AMS-IMS-SIAM Summer Research Conference held at Mt. Holyoke College, South Hadley, MA, July 11-16, 1992. · Zbl 0942.00037
[8] Cavalier, L. and Tsybakov, A. (2002). Sharp adaption for inverse problems with random noise., Prob. Theory Rel. Fields 123 323-354. · Zbl 1039.62031
[9] Dümbgen, L. and Johns, R. B. (2004). Confidence bands for isotonic median curves using sign tests., J. Comput. Graph. Statist. 13 519-533.
[10] Fan, J. (1991). On the optimal rates of convergence for nonparametric deconvolution problems., Ann. Statist. 19 1257-1272. · Zbl 0729.62033
[11] Fan, J. and Li, R. (2004). New estimation and model selection procedures for semiparametric modeling in longitudinal data analysis., Journ. Amer. Statist. Assoc. 99 710-723. · Zbl 1117.62329
[12] Feder, P. I. (1975). On asymptotic distribution theory in segmented regression problems-identified case., Ann. Statist. 3 49-83. · Zbl 0324.62014
[13] Friedrich, F., Kempe, A., Liebscher, V. and Winkler, G. (2008). Complexity penalized, M -estimation: fast computation. J. Comput. Graph. Statist. 17 201-224.
[14] Goldenshluger, A., Juditsky, A., Tsybakov, A. and Zeevi, A. (2008a). Change-point estimation from indirect observations. 1. minimax complexity., Ann. Inst. H. Poincare Probab. Statist. 44 787-818. · Zbl 1206.62048
[15] Goldenshluger, A., Juditsky, A., Tsybakov, A. and Zeevi, A. (2008b). Change-point estimation from indirect observations. 2. adaptiation., Ann. Inst. H. Poincare Probab. Statist. 44 819-836. · Zbl 1206.62047
[16] Goldenshluger, A., Tsybakov, A. and Zeevi, A. (2006). Optimal change-point estimation from indirect observations., Ann. Statist. 34 350-372. · Zbl 1091.62021
[17] Hinkley, D. V. (1969). Inference about the intersection in two-phase regression., Biometrika 56 495-504. · Zbl 0183.48101
[18] Karlin, S. (1968)., Total positivity. Vol. I . Stanford University Press, Stanford, Calif. · Zbl 0219.47030
[19] Karlin, S. and Studden, W. J. (1966)., Tchebycheff systems: With applications in analysis and statistics . Pure and Applied Mathematics, Vol. XV, Interscience Publishers John Wiley & Sons, New York-London-Sydney. · Zbl 0153.38902
[20] Korostelev, A. and Tsybakov, A. (1993)., Minimax theory of image reconstruction. Lecture Notes in Statistics (Springer). 82. New York: Springer-Verlag. xi, 258 p.. · Zbl 0833.62039
[21] Korostelëv, A. P. (1987). Minimax estimation of a discontinuous signal., Teor. Veroyatnost. i Primenen. 32 796-799. · Zbl 0659.62103
[22] Koul, H. L., Qian, L. and Surgailis, D. (2003). Asymptotics of, M -estimators in two-phase linear regression models. Stochastic Process. Appl. 103 123-154. · Zbl 1075.62021
[23] Leeb, H. and Pötscher, B. M. (2006). Can one estimate the conditional distribution of post-model-selection estimators?, Ann. Stat. 34 2554-2591. · Zbl 1106.62029
[24] Leeb, H. and Pötscher, B. M. (2008). Sparse estimators and the oracle property, or the return of the Hodges’ estimator., Journ. Econometrics 142 201-211. · Zbl 1418.62272
[25] Müller, H.-G. (1992). Change-points in nonparametric regression analysis., Ann. Statist. 20 737-761. · Zbl 0783.62032
[26] Müller, H.-G. and Stadtmüller, U. (1999). Discontinuous versus smooth regression., Ann. Statist. 27 299-337. · Zbl 0954.62052
[27] Neumann, M. H. (1997). Optimal change-point estimation in inverse problems., Scand. J. Statist. 24 503-521. · Zbl 0902.62048
[28] Quandt, R. E. (1958). The estimation of the parameters of a linear regression system obeying two separate regimes., J. Amer. Statist. Assoc. 53 873-880. · Zbl 0116.37304
[29] Quandt, R. E. (1960). Tests of the hypothesis that a linear regression system obeys two separate regimes., J. Amer. Statist. Assoc. 55 324-330. · Zbl 0095.13602
[30] Römer, W., Lam, Y. H., Fischer, D., Watts, A., Fischer, W. B., Göring, P., Wehrspohn, R. B., Gösele, U. and Steinem, C. (2004). Channel activity of a viral transmembrane peptide in micro-blms., J. Am. Chem. Soc. 49 16267-16274.
[31] Roths, T., Maier, D., Friedrich, C., Marth, M. and Honerkamp, J. (2000). Determination of the relaxation time spectrum from dynamic moduli using an edge preserving regularization method., Rheol. Acta 39 163-173.
[32] Sacks, J. and Ylvisaker, D. (1970). Designs for regression problems with correlated errors. III., Ann. Math. Statist. 41 2057-2074. · Zbl 0234.62025
[33] Schaback, R. (1999). Native Hilbert spaces for radial basis functions. I. In, New developments in approximation theory (Dortmund, 1998) , vol. 132 of Internat. Ser. Numer. Math. Birkhäuser, Basel, 255-282. · Zbl 0944.46017
[34] Schmitt, E. K., Vrouenraets, M. and Steinem, C. (2006). Channel activity of ompf monitored in nano-blms., Biophys. J. 91 2163-2171.
[35] Sprent, P. (1961). Some hypotheses concerning two phase regression lines., Biometrics 17 634-645. · Zbl 0103.37301
[36] van de Geer, S. A. (1988)., Regression analysis and empirical processes , vol. 45 of CWI Tract . Stichting Mathematisch Centrum Centrum voor Wiskunde en Informatica, Amsterdam. · Zbl 0641.62041
[37] van de Geer, S. A. (2000)., Applications of empirical process theory , vol. 6 of Cambridge Series in Statistical and Probabilistic Mathematics . Cambridge University Press, Cambridge. · Zbl 0953.62049
[38] van der Vaart, A. W. (1998)., Asymptotic statistics , vol. 3 of Cambridge Series in Statistical and Probabilistic Mathematics . Cambridge University Press, Cambridge. · Zbl 0910.62001
[39] Wendland, H. (2005)., Scattered data approximation , vol. 17 of Cambridge Monographs on Applied and Computational Mathematics . Cambridge University Press, Cambridge. · Zbl 1075.65021
[40] Yakir, B., Krieger, A. M. and Pollak, M. (1999). Detecting a change in regression: first-order optimality., Ann. Statist. 27 1896-1913. · Zbl 0963.62077
[41] Yao, Y.-C. and Au, S. T. (1989). Least-squares estimation of a step function., Sankhyā Ser. A 51 370-381. · Zbl 0711.62031
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.