Bounds for Bayesian order identification with application to mixtures. (English) Zbl 1246.62083

Summary: The efficiency of two Bayesian order estimators is studied. By using nonparametric techniques, we prove new underestimation and overestimation bounds. The results apply to various models, including mixture models. In this case, the errors are shown to be \(O(e^{-an})\) and \(O((\log n)^b /\sqrt n)\) \((a,b > 0)\), respectively.


62G05 Nonparametric estimation
62F15 Bayesian inference
Full Text: DOI arXiv


[1] Azencott, R. and Dacunha-Castelle, D. (1986). Series of Irregular Observations . Springer, New York. · Zbl 0593.62088
[2] Bahadur, R. R., Zabell, S. L. and Gupta, J. C. (1980). Large deviations, tests, and estimates. In Asymptotic Theory of Statistical Tests and Estimation 33-64. Academic Press, New York. · Zbl 0601.62037
[3] Barron, A., Schervish, M. J. and Wasserman, L. (1999). The consistency of posterior distributions in nonparametric problems. Ann. Statist. 27 536-561. · Zbl 0980.62039
[4] Chambaz, A. (2006). Testing the order of a model. Ann. Statist. 34 1166-1203. · Zbl 1096.62016
[5] Chen, J. H. (1995). Optimal rate of convergence for finite mixture models. Ann. Statist. 23 221-233. · Zbl 0821.62023
[6] Dacunha-Castelle, D. and Gassiat, E. (1999). Testing the order of a model using locally conic parametrization: Population mixtures and stationary ARMA processes. Ann. Statist. 27 1178-1209. · Zbl 0957.62073
[7] Fraley, C. and Raftery, A. E. (2002). Model-based clustering, discriminant analysis, and density estimation. J. Amer. Statist. Assoc. 97 611-631. JSTOR: · Zbl 1073.62545
[8] Ghosal, S., Ghosh, J. K. and van der Vaart, A. W. (2000). Convergence rates of posterior distributions. Ann. Statist. 28 500-531. · Zbl 1105.62315
[9] Hastie, T., Tibshirani, R. and Friedman, J. (2001). The Elements of Statistical Learning . Springer, New York. · Zbl 0973.62007
[10] Ishwaran, H., James, L. F. and Sun, J. (2001). Bayesian model selection in finite mixtures by marginal density decompositions. J. Amer. Statist. Assoc. 96 1316-1332. JSTOR: · Zbl 1051.62027
[11] Kass, R. E. and Raftery, A. E. (1995). Bayes factors. J. Amer. Statist. Assoc. 90 773-795. · Zbl 0846.62028
[12] Leroux, B. G. (1992). Consistent estimation of a mixing distribution. Ann. Statist. 20 1350-1360. · Zbl 0763.62015
[13] McLachlan, G. and Peel, D. (2000). Finite Mixture Models . Wiley, New York. · Zbl 0963.62061
[14] Mengersen, K. L. and Robert, C. P. (1996). Testing for mixtures: A Bayesian entropic approach. In Bayesian Statistics 5 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 255-276. Oxford Univ. Press.
[15] Moreno, E. and Liseo, B. (2003). A default Bayesian test for the number of components in a mixture. J. Statist. Plann. Inference 111 129-142. · Zbl 1033.62025
[16] Rousseau, J. (2007). Approximating interval hypothesis: p -values and Bayes factors. In Bayesian Statistics 8 417-452. Oxford Univ. Press. · Zbl 1252.62028
[17] Shen, X. and Wasserman, L. (2001). Rates of convergence of posterior distributions. Ann. Statist. 29 687-714. · Zbl 1041.62022
[18] Tierney, L., Kass, R. E. and Kadane, J. B. (1989). Fully exponential Laplace approximations to expectations and variances of nonpositive functions. J. Amer. Statist. Assoc. 84 710-716. JSTOR: · Zbl 0682.62012
[19] Titterington, D. M., Smith, A. F. M. and Makov, U. E. (1985). Statistical Analysis of Finite Mixture Distributions . Wiley, Chichester. · Zbl 0646.62013
[20] Wong, W. H. and Shen, X. (1995). Probability inequalities for likelihood ratios and convergence rates of sieve MLEs. Ann. Statist. 23 339-362. · Zbl 0829.62002
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.