×
Hesse, Christian H.

Iterative density estimation from contaminated observations. (English) Zbl 1100.62042

Metrika 64, No. 2, 151-165 (2006).
Summary: We introduce an iterative procedure for estimating the unknown density of a random variable \(X\) from \(n\) independent copies of \(Y = X +\varepsilon\), where \(\varepsilon\) is the normally distributed measurement error independent of X. Mean integrated squared error convergence rates are studied over function classes arising from Fourier conditions. Minimax rates are derived for these classes. It is found that the sequence of estimators defined by the iterative procedure attains the optimal rates. In addition, it is shown that the sequence of estimators converges exponentially fast to an estimator within the class of deconvoluting kernel density estimators.
The iterative scheme shows how, in practice, density estimation from indirect observations may be performed by simply correcting an appropriate ordinary density estimator. This allows to assess the effect that the perturbation due to contamination by \(\varepsilon\) has on the density to be estimated. We also suggest a method to select the smoothing parameter required by the iterative approach and, utilizing this method, perform a simulation study.

Cited in 1 Document

MSC:

62G07 Density estimation
62G20 Asymptotic properties of nonparametric inference
65C60 Computational problems in statistics (MSC2010)

Keywords:

contaminated observations; density estimation; deconvolution; mean integrated squared error; minimax rates; smoothing parameter; simulation
PDF BibTeX XML Cite
\textit{C. H. Hesse}, Metrika 64, No. 2, 151--165 (2006; Zbl 1100.62042)
Full Text: DOI

References:

[1] Artiles LM (2001) Adaptive minimax estimation in classes of smooth functions. Ph D Thesis, University of Utrecht, Netherlands
[2] Blum T, Susarla V (1977) Estimation of a mixing distribution function. Ann Probab 5:200–209 · Zbl 0358.60040
[3] Carroll RJ, Ruppert D, Stefanski LA (1995) Measurement error in nonlinear models. Chapman Hall, Great Britain · Zbl 0853.62048
[4] Carroll RJ, Hall P (2003) Low-order approximations in deconvolution and regression with errors in variables. Technical Report, Department of Statistics, Texas A & M University
[5] Cator EA (2001) Deconvolution with arbitrary smooth kernels. Stat Prob Lett 54:205–214 · Zbl 0999.62027
[6] Davis KB (1977) Mean integrated square error properties of density estimates. Ann Statist 5:530–535 · Zbl 0359.62031
[7] Diggle PJ, Hall P (1993) A Fourier-approach to nonparametric deconvolution of a density estimate. J R Stat Soc B 55:523–531 · Zbl 0783.62030
[8] Efromovich S (1997) Density estimation in the case of supersmooth measurement error. J Amer Stat Assoc 92:526–535 · Zbl 0890.62027
[9] Fan J (1991a) Asymptotic normality for deconvoluting kernel density estimators. Sankhya A 53:97–110 · Zbl 0729.62034
[10] Fan J (1991b) On the optimal rates of convergence for non-parametric deconvolution problems. Ann Stat 19:1257–1272 · Zbl 0729.62033
[11] Fan J (1992) Deconvolution with supersmooth distributions. Canad J Stat 20:155–169 · Zbl 0754.62020
[12] Fienup JR (1978) Reconstruction of an object from the modulus of its Fourier transform. Optics Lett 3:27–29
[13] Goldenshluger A (1999) On pointwise adaptive nonparametric deconvolution. Bernoulli 5:907–925 · Zbl 0953.62033
[14] Hayes MH, Lim JS, Oppenheim AV (1980) Phase-only signal restoration. In: Proceeding of 1980 int conf acoustics, speech, and signal processing, pp. 437–440
[15] Hesse CH (1995a) Deconvolving a density from partially contaminated observations. J Multivariate Anal 55:246–260 · Zbl 0863.62037
[16] Hesse CH (1995b) How many ”good” observations do you need for ”fast” density deconvolution from supersmooth errors. Sankhya A 58:491–506, 10:343–373
[17] Hesse CH (1999) Data-driven deconvolution. J Nonparam Stat 10:343–373 · Zbl 0936.62038
[18] Ibragimov IA (2001) Estimation of analytic functions. State of the Art in Probability and Statistics, Festschrift for W. R. van Zwet (M. de Gunst, C. Klaassen, A. van der Vaart, eds.) IMS Lecture Notes, 36:359–383
[19] Ibragimov IA, Khasminskii R (1981) Statistical Estimation: Asymptotic Theory. Springer, Heidelberg New York
[20] Kerkyacharian G, Picard D (1992) Density estimation in Besov spaces. Stat and Probab Lett 13:15–24 · Zbl 0749.62026
[21] Landau HJ, Miranker WL (1961) The recovery of distorted band-limited signals. J Math Anal Appl 2:97–104 · Zbl 0098.10703
[22] Liu MC, Taylor RC (1989) A consistent nonparametric density estimator for the deconvolution problem. Can J Stat 17:427–438 · Zbl 0694.62017
[23] Masry E, Rice JA (1992) Gaussian deconvolution via differentiation. Can J Stat 20:9–21 · Zbl 0761.62043
[24] Neumann MH (1997) On the effect of estimating the error density in nonparametric deconvolution. J Nonparam Stat 7:307–330 · Zbl 1003.62514
[25] Papoulis A (1975) A new algorithm in spectral analysis and band-limited extra-polation. IEEE Trans Circuits Syst CAS-22:735–742
[26] Pensky M, Vidakovic B (1999) Adaptive wavelet estimator for nonparametric density deconvolution. Ann Stat 27:2033–2053 · Zbl 0962.62030
[27] Sabri MS, Steenaart W (1978) An approach to bandlimited signal extrapolation: The extrapolation matrix. IEEE Trans Circuits Syst CAS-25:74–78
[28] Schafer RW, Mersereau RM, Richards MA (1981) Constrained iterative restoration algorithms. Proc IEEE 89:432–450
[29] Silverman BW (1986) Density estimation for statistics and data analysis. Chapman and Hall, London · Zbl 0617.62042
[30] Stefanski LA, Carroll RJ (1990) Deconvoluting kernel density estimators. Statistics 21:169–184 · Zbl 0697.62035
[31] Stefanski LA (1990) Rates of convergence of some estimators in a class of deconvolution problems. Stat Prob Lett 9:229–235 · Zbl 0686.62026
[32] Stefanski LA (2000) Measurement error models. J Amer Stat Assoc 95:1353–1358 · Zbl 1072.62693
[33] Thurigen D, Spiegelman D, Blettner M, Heurer C, Brenner H (2000) Measurement error correction using validation data: a review of methods and their applicability in case-control studies. Stat Meth Med Res 9:447–474 · Zbl 1121.62672
[34] Van Es B, Uh HW (2000) Multi-bandwidth kernel estimators for nonparametric deconvolution problems: asymptotics and finite sample performance. J Nonparam Stat 13:107–128 · Zbl 0960.62040
[35] Watson GS, Leadbetter MR (1963) On the estimation of the probability density. I Ann Math Stat 34:480–491 · Zbl 0113.34504
[36] Yuan M, Chen JQ (2002) Deconvolving multidimensional density from partially contaminated observations. J Stat Plann Inf 104:147–160 · Zbl 1011.62039
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.