Entropy estimate for high-dimensional monotonic functions. (English) Zbl 1221.62008

Summary: We establish upper and lower bounds for the metric entropy and bracketing entropy of the class of \(d\)-dimensional bounded monotonic functions under \(L^p\) norms. It is interesting to see that both the metric entropy and bracketing entropy have different behaviors for \(p<d/(d-1)\) and \(p>d/(d-1)\). We apply the new bounds for the bracketing entropy to establish a global rate of convergence of the MLE of a \(d\)-dimensional monotone density.


62B10 Statistical aspects of information-theoretic topics
62G05 Nonparametric estimation
62G20 Asymptotic properties of nonparametric inference
Full Text: DOI arXiv Link


[1] Biau, G.; Devroye, L., On the risk of estimates for block decreasing densities, J. multivariate anal., 86, 143-165, (2003) · Zbl 1025.62015
[2] Birgé, L., On estimating a density using Hellinger distance and some other strange facts, Probab. theory related fields, 71, 271-291, (1986) · Zbl 0561.62029
[3] Birgé, L., Estimating a density under order restrictions, nonasymptotic minimax risk, Ann. statist., 15, 995-1012, (1987) · Zbl 0631.62037
[4] Birgé, L., On the risk of histograms for estimating decreasing densities, Ann. statist., 15, 1013-1022, (1987) · Zbl 0646.62033
[5] Birgé, L., The grenander estimator: a nonasymptotic approach, Ann. statist., 17, 1532-1549, (1989) · Zbl 0703.62042
[6] Birgé, L.; Massart, P., Rates of convergence for minimum contrast estimators, Probab. theory related fields, 97, 113-150, (1993) · Zbl 0805.62037
[7] Birgé, L.; Massart, P., An adaptive compression algorithm in Besov spaces, Constr. approx., 16, 1, 1-36, (2000) · Zbl 1004.41006
[8] R. Blei, F. Gao, W. Li, Metric entropy of high dimensional distributions, P. Am. Math. Soc., to appear. · Zbl 1147.46018
[9] Carl, B., Metric entropy of convex hulls in Hilbert spaces, Bull. London math. soc., 29, 452-458, (1997) · Zbl 0879.41012
[10] Carl, B.; Kyrezi, I.; Pajor, A., Metric entropy of convex hulls in Banach spaces, J. London math. soc., 60, 871-896, (1999) · Zbl 0976.46009
[11] R.M. Dudley, A course on empirical processes, Lecture Notes in Mathematics, vol. 1097, Springer, Berlin, 1984. · Zbl 0554.60029
[12] Dudley, R.M., Uniform central limit theorems, (1999), Cambridge University Press Cambridge, England · Zbl 0951.60033
[13] Edmunds, D.E.; Triebel, H., Function spaces, entropy numbers and differential operators, (1996), Cambridge University Press Cambridge, England · Zbl 0629.46034
[14] Gao, F., Entropy of absolute convex hulls in Hilbert spaces, Bull. London math. soc., 36, 460-468, (2004) · Zbl 1060.41023
[15] Polonik, W., Density estimation under qualitative assumptions in higher dimensions, J. multivariate anal., 55, 61-81, (1995) · Zbl 0847.62027
[16] Polonik, W., The silhouette, concentration functions, and ML-density estimation under order restrictions, Ann. statist., 26, 1857-1877, (1998) · Zbl 1073.62523
[17] Rudelson, M.; Vershynin, R., Combinatorics of random processes and sections of convex bodies, Annals of math., 164, 603-648, (2006) · Zbl 1114.60009
[18] van der Vaart, A.W.; Wellner, J.A., Weak convergence and empirical processes, (1996), Springer New York · Zbl 0862.60002
[19] Ziemer, W.P., Weakly differentiable functions, (1989), Springer New York · Zbl 0177.08006
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.