Bayesian inference and the parametric bootstrap. (English) Zbl 1257.62027

Summary: The parametric bootstrap can be used for the efficient computation of Bayes posterior distributions. Importance sampling formulas take on an easy form relating to the deviance in exponential families and are particularly simple starting from Jeffreys invariant prior. Because of the i.i.d. nature of bootstrap sampling, familiar formulas describe the computational accuracy of the Bayes estimates. Besides computational methods, the theory provides a connection between Bayesian and frequentist analysis. Efficient algorithms for the frequentist accuracy of Bayesian inferences are developed and demonstrated in a model selection example.


62F15 Bayesian inference
62F40 Bootstrap, jackknife and other resampling methods
62J12 Generalized linear models (logistic models)
65C60 Computational problems in statistics (MSC2010)


Full Text: DOI arXiv Euclid


[1] Berger, J. (2006). The case for objective Bayesian analysis. Bayesian Anal. 1 385-402. · Zbl 1331.62042 · doi:10.1214/06-BA115
[2] DiCiccio, T. and Efron, B. (1992). More accurate confidence intervals in exponential families. Biometrika 79 231-245. · Zbl 0752.62027 · doi:10.1093/biomet/79.2.231
[3] DiCiccio, T. J. and Efron, B. (1996). Bootstrap confidence intervals. Statist. Sci. 11 189-228. With comments and a rejoinder by the authors. · Zbl 0955.62574 · doi:10.1214/ss/1032280214
[4] Efron, B. (1982). The Jackknife , the Bootstrap and Other Resampling Plans. CBMS-NSF Regional Conference Series in Applied Mathematics 38 . SIAM, Philadelphia, PA. · Zbl 0496.62036
[5] Efron, B. (1987). Better bootstrap confidence intervals. J. Amer. Statist. Assoc. 82 171-200. With comments and a rejoinder by the author. · Zbl 0622.62039 · doi:10.2307/2289144
[6] Efron, B. (1992). Jackknife-after-bootstrap standard errors and influence functions. J. R. Stat. Soc. Ser. B Stat. Methodol. 54 83-127. · Zbl 0782.62051
[7] Efron, B. (2008). Microarrays, empirical Bayes and the two-groups model. Statist. Sci. 23 1-22. · Zbl 1327.62046 · doi:10.1214/07-STS236
[8] Efron, B. (2010). Large-Scale Inference : Empirical Bayes Methods for Estimation , Testing , and Prediction. Institute of Mathematical Statistics ( IMS ) Monographs 1 . Cambridge Univ. Press, Cambridge. · Zbl 1277.62016
[9] Efron, B. and Tibshirani, R. J. (1993). An Introduction to the Bootstrap. Monographs on Statistics and Applied Probability 57 . Chapman & Hall, New York. · Zbl 0835.62038
[10] Efron, B. and Tibshirani, R. (1998). The problem of regions. Ann. Statist. 26 1687-1718. · Zbl 0954.62031 · doi:10.1214/aos/1024691353
[11] Gelman, A., Meng, X.-L. and Stern, H. (1996). Posterior predictive assessment of model fitness via realized discrepancies. Statist. Sinica 6 733-807. With comments and a rejoinder by the authors. · Zbl 0859.62028
[12] Ghosh, M. (2011). Objective priors: An introduction for frequentists. Statist. Sci. 26 187-202. · Zbl 1246.62045 · doi:10.1214/10-STS338
[13] Johnson, N. L. and Kotz, S. (1970). Distributions in Statistics. Continuous Univariate Distributions . 2. Houghton, Boston, MA. · Zbl 0213.21101
[14] Kass, R. E. and Wasserman, L. (1996). The selection of prior distributions by formal rules. J. Amer. Statist. Assoc. 91 1343-1370. · Zbl 0884.62007 · doi:10.2307/2291752
[15] Mardia, K. V., Kent, J. T. and Bibby, J. M. (1979). Multivariate Analysis . Academic Press, London. · Zbl 0432.62029
[16] Newton, M. A. and Raftery, A. E. (1994). Approximate Bayesian inference with the weighted likelihood bootstrap. J. R. Stat. Soc. Ser. B Stat. Methodol. 56 3-48. With discussion and a reply by the authors. · Zbl 0788.62026
[17] Rubin, D. B. (1981). The Bayesian bootstrap. Ann. Statist. 9 130-134. · doi:10.1214/aos/1176345338
[18] Singh, D., Febbo, P. G., Ross, K., Jackson, D. G., Manola, J., Ladd, C., Tamayo, P., Renshaw, A. A., D’Amico, A. V., Richie, J. P., Lander, E. S., Loda, M., Kantoff, P. W., Golub, T. R. and Sellers, W. R. (2002). Gene expression correlates of clinical prostate cancer behavior. Cancer Cell 1 203-209.
[19] Smith, A. F. M. and Gelfand, A. E. (1992). Bayesian statistics without tears: A sampling-resampling perspective. Amer. Statist. 46 84-88.
[20] Tibshirani, R. (1989). Noninformative priors for one parameter of many. Biometrika 76 604-608. · Zbl 0678.62010 · doi:10.1093/biomet/76.3.604
[21] Tierney, L. and Kadane, J. B. (1986). Accurate approximations for posterior moments and marginal densities. J. Amer. Statist. Assoc. 81 82-86. · Zbl 0587.62067 · doi:10.2307/2287970
[22] Welch, B. L. and Peers, H. W. (1963). On formulae for confidence points based on integrals of weighted likelihoods. J. R. Stat. Soc. Ser. B Stat. Methodol. 25 318-329. · Zbl 0117.14205
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.