×
Dembo, Amir

Information inequalities and concentration of measure. (English) Zbl 0880.60018

Ann. Probab. 25, No. 2, 927-939 (1997).
Summary: We derive inequalities of the form \(\Delta(P,Q)\leq H(P|R)+ H(Q|R)\) which hold for every choice of probability measures \(P\), \(Q\), \(R\), where \(H(P|R)\) denotes the relative entropy of \(P\) with respect to \(R\) and \(\Delta(P,Q)\) stands for a coupling type “distance” between \(P\) and \(Q\). Using the chain rule for relative entropies and then specializing to \(Q\) with a given support we recover some of Talagrand’s concentration of measure inequalities for product spaces.

Cited in 22 Documents

MSC:

60E15 Inequalities; stochastic orderings
28A35 Measures and integrals in product spaces

Keywords:

concentration of measure; information inequalities
PDF BibTeX XML Cite
\textit{A. Dembo}, Ann. Probab. 25, No. 2, 927--939 (1997; Zbl 0880.60018)
Full Text: DOI
  • logo of hbz
  • logo of WorldCat

References:

[1] Dembo, A. and Zeitouni, O. (1993). Large Deviations Techniques and Applications. Jones and Bartlett, Boston. · Zbl 0793.60030
[2] Dembo, A. and Zeitouni, O. (1996). Transportation approach to some concentration inequalities in product spaces. Elect. Comm. in Probab. 1 83-90. · Zbl 0916.28003
[3] Deuschel, J. D. and Stroock, D. W. (1989). Large Deviations. Academic Press, Boston. · Zbl 0675.60086
[4] Ledoux, M. (1996). On Talagrand’s deviation inequalities for product measures. ESAIM: Probab. and Statist. 1 63-87. · Zbl 0869.60013
[5] Marton, K. (1986). A simple proof of the blowing-up lemma. IEEE Trans. Inform. Theory IT-32 445-446. · Zbl 0594.94003
[6] Marton, K. (1996). Bounding \? d-distance by information divergence: a method to prove measure concentration. Ann. Probab. 24 857-866. · Zbl 0865.60017
[7] Marton, K. (1996). A measure concentration inequality for contracting Markov chains. GAFA 6 556-571. · Zbl 0856.60072
[8] Ramachandan, D. and R üschendorf, L. (1995). A general duality theorem for marginal problems. Probab. Theory Related Fields 101 311-319. · Zbl 0818.60001
[9] Talagrand, M. (1995). Concentration of measure and isoperimetric inequalities in product spaces. Publications Mathématiques de l’I.H.E.S. 81 73-205. · Zbl 0864.60013
[10] Talagrand, M. (1996). New concentration inequalities in product spaces. Invent. Math. 126 505-563. · Zbl 0893.60001
[11] Talagrand, M. (1996). Transportation cost for Gaussian and other product measures. Geom. Funct. Anal. 6 587-600. · Zbl 0859.46030
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.