zbMATH — the first resource for mathematics

Computational enhancements to Bayesian design of experiments using Gaussian processes. (English) Zbl 1359.62322
Summary: Bayesian design of experiments is a methodology for incorporating prior information into the design phase of an experiment. Unfortunately, the typical Bayesian approach to designing experiments is both numerically and analytically intractable without additional assumptions or approximations. In this paper, we discuss how Gaussian processes can be used to help alleviate the numerical issues associated with Bayesian design of experiments. We provide an example based on accelerated life tests and compare our results with large-sample methods.

62K05 Optimal statistical designs
62F15 Bayesian inference
62K20 Response surface designs
62L05 Sequential statistical design
Full Text: DOI Euclid
[1] Adler, R. J. (1981). The Geometry of Random Fields . New York: J. Wiley. · Zbl 0478.60059
[2] Anderson-Cook, C. M., Graves, T. L., and Hamada, M. S. (2008). “Resource allocation: Sequential design for analyses involving several types of data.” In: IEEE International Conference on Industrial Engineering and Engineering Management, 2008. IEEM 2008 , 571-575. IEEE.
[3] - (2009). “Resource allocation for reliability of a complex system with aging components.” Quality and Reliability Engineering International , 25(4): 481-494.
[4] Chaloner, K. and Larntz, K. (1992). “Bayesian design for accelerated life testing.” Journal of Statistical Planning and Inference , 33(2): 245-259. · Zbl 0781.62149 · doi:10.1016/0378-3758(92)90071-Y
[5] Chaloner, K. and Verdinelli, I. (1995). “Bayesian Experimental Design: A Review.” Statistical Science , 10(3): pp. 273-304. URL: · Zbl 0955.62617 · doi:10.1214/ss/1177009939 · www.jstor.org
[6] Chib, S. and Greenberg, E. (1995). “Understanding the Metropolis-Hastings algorithm.” The American Statistician , 327-335.
[7] Clyde, M., Müller, P., and Parmigiani, G. (1995). “Optimal Design for Heart Defibrillators.” In: Gatsonis, C., Hodges, J., Kass, R., and Singpurwalla, N. (eds.), Case Studies in Bayesian Statistics 2 , 278-292. Springer. · Zbl 0825.92074
[8] Cramér, H. and Leadbetter, M. R. (1967). Stationary and Related Stochastic Processes . New York: J. Wiley. · Zbl 0162.21102
[9] Drovandi, C. C., McGree, J. M., and Pettitt, A. N. (2013). “Sequential Monte Carlo for Bayesian sequentially designed experiments for discrete data.” Computational Statistics and Data Analysis , 57(1): 320-335. · Zbl 1365.62318
[10] - (2014). “A sequential Monte Carlo algorithm to incorporate model uncertainty in Bayesian sequential design.” Journal of Computational and Graphical Statistics , 23(1): 3-24. · doi:10.1080/10618600.2012.730083
[11] Escobar, L. and Meeker, W. (1994). “Algorithm AS 292: Fisher information matrix for the extreme value, normal and logistic distributions and censored data.” Journal of the Royal Statistical Society. Series C (Applied Statistics) , 43(3): 533-540.
[12] Etzioni, R. and Kadane, J. B. (1993). “Optimal experimental design for another’s analysis.” Journal of the American Statistical Association , 88(424): 1404-1411. · Zbl 0792.62062 · doi:10.2307/2291284
[13] Gramacy, R. and Lee, H. (2010). “Optimization under Unknown Constraints.” In: Bernardo, J. M., Bayarri, M. J., Berger, J. O., P, D. A., Heckerman, A. F. M., and Smith, M. W. (eds.), Bayesian Statistics . Oxford: Oxford University Press, 9th edition. · doi:10.1093/acprof:oso/9780199694587.003.0008
[14] Hamada, M., Martz, H., Reese, C., and Wilson, A. (2001). “Finding near-optimal Bayesian experimental designs via genetic algorithms.” The American Statistician , 55(3): 175-181. · Zbl 1182.62156 · doi:10.1198/000313001317098121
[15] Huan, X. and Marzoukm Y. M. (2013). “Simulation-based optimal Bayesian experimental design for nonlinear systems.” Journal of Computational Physics , 232(1): 288-317. · doi:10.1016/j.jcp.2012.08.013
[16] Huang, D., Allen, T. T., Notz, W. I., and Zeng, N. (2006). “Global optimization of stochastic black-box systems via sequential Kriging meta-models.” Journal of Global Optimization , 34(3): 441-466. · Zbl 1098.90097 · doi:10.1007/s10898-005-2454-3
[17] Jones, D. R., Schonlau, M., and Welch, W. J. (1998). “Efficient Global Optimization of Expensive Black-Box Functions.” Journal of Global Optimization , 13: 455-492. · Zbl 0917.90270 · doi:10.1023/A:1008306431147
[18] Lindley, D. V. (1972). Bayesian Statistics - A Review . SIAM. · Zbl 0246.62009
[19] Matérn, B. (1986). Spatial Variation . Springer Verlag, second edition. · Zbl 0608.62122
[20] McKay, M. D., Beckman, R. J., and Conover, W. J. (1979). “Comparison of three methods for selecting values of input variables in the analysis of output from a computer code.” Technometrics , 21(2): 239-245. · Zbl 0415.62011 · doi:10.2307/1268522
[21] Meeker, W. and Escobar, L. (1998). Statistical methods for reliability data . John Wiley and Sons, INC. · Zbl 0949.62086
[22] Müller, P. (1999). “Simulation Based Optimal Design.” In: Bernardo, J. M., Berger, J. O., Dawid, A. P., and Smith, A. F. M. (eds.), Bayesian Statistics 6 , 459-474. Oxford University Press. · Zbl 0974.62058
[23] Picard, R. and Williams, B. (2013). “Rare event estimation for computer models.” The American Statistician , 67(1): 22-32. · doi:10.1080/00031305.2012.751879
[24] Picheny, V., Ginsbourger, D., Richet, Y., and Caplin, G. (2013). “Quantile-Based Optimization of Noisy Computer Experiments With Tunable Precision.” Technometrics , 55: 2-13. · doi:10.1080/00401706.2012.707580
[25] Raiffa, H. and Schlaifer, R. (1961). Applied Statistical Decision Theory . Division of Research, Graduate School of Business Administration. · Zbl 0952.62008
[26] Robert, C. and Casella, G. (2004). Monte Carlo statistical methods . Springer Verlag. · Zbl 1096.62003
[27] Roustant, O., Ginsbourger, D., and Deville, Y. (2012). “DiceKriging, DiceOptim: Two R Packages for the Analysis of Computer Experiments by Kriging-Based Metamodeling and Optimization.” Journal of Statistical Software , 51: 1-55.
[28] Santner, T. J., Williams, B. J., and Notz, W. I. (2003). The Design and Analysis of Computer Experiments . New York: Springer. · Zbl 1041.62068
[29] Tsutakawa, R. K. (1972). “Design of experiment for bioassay.” Journal of the American Statistical Association , 67(339): 584-590. · Zbl 0251.62051 · doi:10.2307/2284443
[30] Zhang, Y. and Meeker, W. (2006). “Bayesian methods for planning accelerated life tests.” Technometrics , 48(1): 49-60. · doi:10.1198/004017005000000373
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.