×
Drovandi, Christopher C.; Tran, Minh-Ngoc

Improving the efficiency of fully Bayesian optimal design of experiments using randomised quasi-Monte Carlo. (English) Zbl 06873721

Bayesian Anal. 13, No. 1, 139-162 (2018).
Summary: Optimal experimental design is an important methodology for most efficiently allocating resources in an experiment to best achieve some goal. Bayesian experimental design considers the potential impact that various choices of the controllable variables have on the posterior distribution of the unknowns. Optimal Bayesian design involves maximising an expected utility function, which is an analytically intractable integral over the prior predictive distribution. These integrals are typically estimated via standard Monte Carlo methods. In this paper, we demonstrate that the use of randomised quasi-Monte Carlo can bring significant reductions to the variance of the estimated expected utility. This variance reduction can then lead to a more efficient optimisation algorithm for maximising the expected utility.

Cited in 9 Documents

MSC:

62K05 Optimal statistical designs
62D05 Sampling theory, sample surveys

Keywords:

approximate Bayesian computation; evidence; experimental design; importance sampling; mutual information; Laplace approximation; quasi-Monte Carlo
Cite Review PDF
Full Text: DOI Euclid

References:

[1] Berger, J. (1985). Statistical Decision Theory and Bayesian Analysis. New York: Springer-Verlag. · Zbl 0572.62008
[2] Bernardo, J. M. and Smith, A. (2000). Bayesian Theory. Chichester: Wiley. · Zbl 0943.62009
[3] Bliemer, M. C. J., Rose, J. M., and Hess, S. (2008). “Approximation of Bayesian efficiency in experimental choice designs.” Journal of Choice Modelling, 1(1): 98-126.
[4] Box, G. E. and Muller, M. E. (1958). “A note on the generation of random normal deviates.” The Annals of Mathematical Statistics, 29(2): 610-611. · Zbl 0085.13720
[5] Box, G. E. P. and Hill, W. J. (1967). “Discrimination among mechanistic models.” Technometrics, 9: 57-71.
[6] Cook, A. R., Gibson, G. J., and Gilligan, C. A. (2008). “Optimal observation times in experimental epidemic processes.” Biometrics, 64(3): 860-868. · Zbl 1146.62081 · doi:10.1111/j.1541-0420.2007.00931.x
[7] Dehideniya, M. B., Drovandi, C. C., and McGree, J. M. (2016). “Effcient Bayesian Design for Discriminating Between Models with Intractable Likelihoods in Epidemiology.” https://eprints.qut.edu.au/97824/. · Zbl 1469.62053
[8] Dick, J. and Pillichshammer, F. (2010). Digital Nets and Sequence. Discrepancy Theory and Quasi-Monte Carlo Integration. Cambridge: Cambridge University Press. · Zbl 1282.65012
[9] Drovandi, C. C., McGree, J. M., and Pettitt, A. N. (2013). “Sequential Monte Carlo for Bayesian sequentially designed experiments for discrete data.” Computational Statistics and Data Analysis, 57: 320-335. · Zbl 1365.62318
[10] Drovandi, C. C., McGree, J. M., and Pettitt, A. N. (2014). “A sequential Monte Carlo algorithm to incorporate model uncertainty in Bayesian sequential design.” Journal of Computational and Graphical Statistics, 23: 3-24.
[11] Drovandi, C. C. and Pettitt, A. N. (2013). “Bayesian experimental design for models with intractable likelihoods.” Biometrics, 69(4): 937-948. · Zbl 1419.62182
[12] Gerber, M. and Chopin, N. (2015). “Sequential quasi Monte Carlo.” Journal of the Royal Statistical Society: Series B (Statistical Methodology), 77(3): 509-579. · Zbl 1414.62109
[13] Gillespie, D. T. (1977). “Exact stochastic simulation of coupled chemical reactions.” The Journal of Physical Chemistry, 81(25): 2340-2361.
[14] Glasserman, P. (2004). Monte Carlo Methods in Financial Engineering. New York: Springer-Verlag. · Zbl 1038.91045
[15] Gotwalt, C. M., Jones, B. A., and Steinberg, D. M. (2009). “Fast computation of designs robust to parameter uncertainty for nonlinear settings.” Technometrics, 51: 88-95.
[16] Hainy, M., Müller, W. G., and Wagner, H. (2014). “Likelihood-Free Simulation-Based Optimal Design: An Introduction.” In Melas, V., Mignani, S., Monari, P., and Salmaso, L. (eds.), Topics in Statistical Simulation, 271-278. Springer.
[17] Halton, J. H. (1960). “On the efficiency of certain quasi-random sequences of points in evaluating multi-dimensional integrals.” Numerische Mathematik, 2: 84-90. · Zbl 0090.34505
[18] Hammersley, J. M. (1960). “Monte Carlo methods for solving multivariable problems.” Annals of the New York Academy of Sciences, 86: 844-874. · Zbl 0111.12405
[19] Huan, X. and Marzouk, Y. M. (2014). “Gradient-based stochastic optimization methods in Bayesian experimental design.” International Journal for Uncertainty Quantification, 4(6): 479-510. · Zbl 1497.62069
[20] Loh, W.-L. (2003). “On the asymptotic distribution of scrambled net quadrature.” Annals of Statistics, 31: 1282-1324. · Zbl 1105.62304
[21] Matousek, J. (1998). “On the L2-discrepancy for anchored boxes.” Journal of Complexity, 14: 527-556. · Zbl 0942.65021
[22] McGree, J. M., Drovandi, C. C., White, G., and Pettitt, A. N. (2016). “A pseudo-marginal sequential Monte Carlo algorithm for random effects models in Bayesian sequential design.” Statistics and Computing, 26(5): 1121-1136. · Zbl 1505.62284
[23] Meyer, R. K. and Nachtsheim, C. J. (1995). “The coordinate-exchange algorithm for constructing exact optimal experimental designs.” Technometrics, 37: 60-69. · Zbl 0825.62652
[24] Moler, C. and van Loan, C. (2003). “Nineteen dubious ways to compute the exponential of a matrix, twenty-five years later.” SIAM Review, 45(1): 3-49. · Zbl 1030.65029
[25] Müller, P., Sansó, B., and De Iorio, M. (2004). “Optimal Bayesian design by inhomogeneous Markov chain simulation.” Journal of the American Statistical Association, 99(467): 788-798. · Zbl 1117.62404
[26] Niederreiter, H. (1992). Random Number Generation and Quasi-Monte Carlo Methods. Philadelphia: Society for Industrial and Applied Mathematics. · Zbl 0761.65002
[27] Overstall, A. M., McGree, J. M., and Drovandi, C. C. (2016). “Fully Bayesian optimal design using the approximate coordinate exchange algorithm and normal-based approximations to posterior quantities.” https://arxiv.org/abs/1608.05815.
[28] Overstall, A. M. and Woods, D. C. (2016). “Bayesian Design of Experiments using Approximate Coordinate Exchange.” arXiv:1501.00264.
[29] Owen, A. B. (1997). “Scrambled net variance for integrals of smooth functions.” Annals of Statistics, 25: 1541-1562. · Zbl 0886.65018
[30] Robert, C. P. (2007). The Bayesian Choice: From Decision-Theoretic Foundations to Computational Implementation. Springer Science & Business Media. · Zbl 1129.62003
[31] Ryan, E. G., Drovandi, C. C., McGree, J. M., and Pettitt, A. N. (2016). “A review of modern computational algorithms for Bayesian optimal design.” International Statistical Review, 84: 128-154. · Zbl 07763475
[32] Ryan, E. G., Drovandi, C. C., and Pettitt, A. N. (2015). “Fully Bayesian experimental design for Pharmacokinetic studies.” Entropy, 17: 1063-1089.
[33] Ryan, E. G., Drovandi, C. C., Thompson, M. H., and Pettitt, A. N. (2014). “Towards Bayesian experimental design for nonlinear models that require a large number of sampling times.” Computational Statistics and Data Analysis, 70: 45-60. · Zbl 1471.62175
[34] Tran, M., Nott, D. J., and Kohn, R. (2015). “Variational Bayes with Intractable Likelihood.” arXiv:1503.08621.
[35] van der Corput, J. G. (1935). “Verteilungsfunktionen. I. Mitt.” Proceedings. Akadamie van Wetenschappen Amsterdam (in German), 38: 813-821. · Zbl 0012.34705
[36] Weaver, B. P., Williams, B. J., Anderson-Cook, C. M., and Higdon, D. M. (2016). “Computational enhancements to Bayesian design of experiments using Gaussian processes.” Bayesian Analysis, 11(1): 191-213. · Zbl 1359.62322 · doi:10.1214/15-BA945
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.