zbMATH — the first resource for mathematics

Bernstein-von Mises theorems for Gaussian regression with increasing number of regressors. (English) Zbl 1231.62061
Summary: This paper brings a contribution to the Bayesian theory of nonparametric and semiparametric estimation. We are interested in the asymptotic normality of the posterior distribution in Gaussian linear regression models when the number of regressors increases with the sample size. Two kinds of Bernstein-von Mises theorems are obtained in this framework: nonparametric theorems for the parameter itself, and semiparametric theorems for functionals of the parameter. We apply them to the Gaussian sequence model and to the regression of functions in Sobolev and $$C^{\alpha }$$ classes, in which we get the minimax convergence rates. Adaptivity is reached for the Bayesian estimators of functionals in our applications.

MSC:
 62G08 Nonparametric regression and quantile regression 62F15 Bayesian inference 62J05 Linear regression; mixed models 62G20 Asymptotic properties of nonparametric inference 62G05 Nonparametric estimation
Full Text:
References:
 [1] Bontemps, D. (2011). Supplement to “Bernstein-von Mises theorems for Gaussian regression with increasing number of regressors.” . · Zbl 1231.62061 [2] Boucheron, S. and Gassiat, E. (2009). A Bernstein-von Mises theorem for discrete probability distributions. Electron. J. Stat. 3 114-148. · Zbl 1326.62036 [3] Castillo, I. (2010). A semi-parametric Bernstein-von Mises theorem. Probab. Theory Related Fields . . [4] Clarke, B. S. and Barron, A. R. (1990). Information-theoretic asymptotics of Bayes methods. IEEE Trans. Inform. Theory 36 453-471. · Zbl 0709.62008 [5] Clarke, B. and Ghosal, S. (2010). Reference priors for exponential families with increasing dimension. Electron. J. Stat. 4 737-780. · Zbl 1329.62120 [6] de Boor, C. (1978). A Practical Guide to Splines. Applied Mathematical Sciences 27 . Springer, New York. · Zbl 0406.41003 [7] Freedman, D. (1999). Wald lecture: On the Bernstein-von Mises theorem with infinite-dimensional parameters. Ann. Statist. 27 1119-1140. · Zbl 0957.62002 [8] Ghosal, S. (1999). Asymptotic normality of posterior distributions in high-dimensional linear models. Bernoulli 5 315-331. · Zbl 0948.62007 [9] Ghosal, S. (2000). Asymptotic normality of posterior distributions for exponential families when the number of parameters tends to infinity. J. Multivariate Anal. 74 49-68. · Zbl 1118.62309 [10] Ghosal, S., Ghosh, J. K. and van der Vaart, A. W. (2000). Convergence rates of posterior distributions. Ann. Statist. 28 500-531. · Zbl 1105.62315 [11] Ghosal, S. and van der Vaart, A. (2007). Convergence rates of posterior distributions for non-i.i.d. observations. Ann. Statist. 35 192-223. · Zbl 1114.62060 [12] Kim, Y. (2006). The Bernstein-von Mises theorem for the proportional hazard model. Ann. Statist. 34 1678-1700. · Zbl 1246.62050 [13] Kim, Y. and Lee, J. (2004). A Bernstein-von Mises theorem in the nonparametric right-censoring model. Ann. Statist. 32 1492-1512. · Zbl 1047.62043 [14] Massart, P. (2007). Concentration Inequalities and Model Selection. Lecture Notes in Math. 1896 . Springer, Berlin. · Zbl 1170.60006 [15] Rivoirard, V. and Rousseau, J. (2009). Bernstein von Mises theorem for linear functionals of the density. Available at . · Zbl 1257.62036 [16] Shen, X. (2002). Asymptotic normality of semiparametric and nonparametric posterior distributions. J. Amer. Statist. Assoc. 97 222-235. · Zbl 1073.62517 [17] Shen, X. and Wasserman, L. (2001). Rates of convergence of posterior distributions. Ann. Statist. 29 687-714. · Zbl 1041.62022 [18] Tsybakov, A. B. (2004). Introduction à L’estimation Non-Paramétrique . Springer, Berlin. · Zbl 1029.62034 [19] van der Vaart, A. W. (1998). Asymptotic Statistics . Cambridge Univ. Press, Cambridge. · Zbl 0910.62001
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.