zbMATH — the first resource for mathematics

Batch sequential designs for computer experiments. (English) Zbl 1185.62142
Summary: Computer models simulating a physical process are used in many areas of science. Due to the complex nature of these codes it is often necessary to approximate the code, which is typically done using a Gaussian process. In many situations the number of code runs available to build the Gaussian process approximation is limited. When the initial design is small or the underlying response surface is complicated this can lead to poor approximations of the code output. In order to improve the fit of the model, sequential design strategies must be employed. We introduce two simple distance based metrics that can be used to augment an initial design in a batch sequential manner. In addition we propose a sequential updating strategy to an orthogonal array based Latin hypercube sample. We show via various real and simulated examples that the distance metrics and the extension of the orthogonal array based Latin hypercubes work well in practice.

62L05 Sequential statistical design
68U20 Simulation (MSC2010)
05B15 Orthogonal arrays, Latin squares, Room squares
65C60 Computational problems in statistics (MSC2010)
EGO; Sostools
Full Text: DOI
[1] Aslett, R.; Buck, R.J.; Duvall, S.G.; Sacks, J.; Welch, W.J., Circuit optimization via sequential computer experiments: design of an output buffer, Applied statistics, 47, 31-48, (1998) · Zbl 0904.62118
[2] Bastos, L.S., O’Hagan, A., 2008. Diagnostics for Gaussian process emulators. Technometrics 51, 425-438.
[3] Bernardo, M.C.; Buck, R.; Liu, L.; Nazaret, W.A.; Sacks, J.; Welch, W.J., Integrated circuit design optimization using a sequential strategy, IEEE transaction on computer aided design, 11, 361-372, (1992)
[4] Blackwell, D., Comparison of experiment, (), 93-102
[5] Currin, C.; Mitchell, T.; Morris, M.; Ylvisaker, D., Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments, Journal of the American statistical association, 86, 953-963, (1991)
[6] Fedorov, V.V., Theory of optimal design, (1972), Academic New York
[7] Gough, W.A.; Welch, W.J., Parameter space exploration of an Ocean general circulation model using an isopycnal mixing parameterization, Journal of marine research, 52, 773-796, (1994)
[8] Hedayat, A.S.; Sloane, N.J.; Stufken, J., Orthogonal arrays: theory and applications, (1999), Springer New York · Zbl 0935.05001
[9] Higdon, D.; Gattiker, J.; Williams, B.; Rightley, M., Computer model calibration using high-dimensional output, Journal of the American statistical association, 103, 570-583, (2008) · Zbl 05564511
[10] Higdon, D.; Kennedy, M.; Cavendish, J.C.; Cafeo, J.A.; Ryne, R.D., Combining field data and computer simulation for calibration and prediction, SIAM journal on scientific computing, 26, 448-466, (2004) · Zbl 1072.62018
[11] Johnson, M.E.; Moore, L.M.; Ylvisaker, D., Minimax and maximin distance designs, Journal of statistical planning and inference, 26, 131-148, (1990)
[12] Jones, D.R.; Schonlau, M.; Welch, W.J., Efficient global optimization of expensive black-box functions, Journal of global optimization, 13, 455-492, (1998) · Zbl 0917.90270
[13] Lam, C.Q., Notz, W.I., 2008. Sequential adaptive designs in computer experiments for response surface model fit. Statistics and Applications 6, 207-233.
[14] Lindley, D.V., On a measure of information provided by an experiment, Annals of mathematical statistics, 27, 986-1005, (1956) · Zbl 0073.14103
[15] Loeppky, J.L., Sacks, J., Welch, W.J., 2008. Choosing the sample size of a computer experiment: a practical guide. Technometrics 51, 366-376.
[16] McKay, M.D.; Beckman, R.J.; Conover, W.J., A comparison of three methods for selecting values of input variables in the analysis of output from a computer code, Technometrics, 21, 239-245, (1979) · Zbl 0415.62011
[17] Mitchell, T.J.; Morris, M.D., Bayesian design and analysis of computer experiments: two examples, Statistica sinica, 2, 359-379, (1992) · Zbl 0827.62029
[18] Morris, M.D.; Mitchell, T.J., Exploratory designs for computational experiments, Journal of statistical planning and inference, 43, 381-402, (1995) · Zbl 0813.62065
[19] O’Hagan, A., Some Bayesian numerical analysis, (), 345-363
[20] Owen, A.B., Controlling correlations in Latin hypercube samples, Journal of the American statistical association, 89, 1517-1522, (1994) · Zbl 0813.65060
[21] Preston, D.L.; Tonks, D.L.; Wallace, D.C., Model of plastic deformation for extreme loading conditions, Journal of applied physics, 93, 211-220, (2003)
[22] Ranjan, P.; Bingham, D.; Michailidis, G., Sequential experiment design for contour estimation from complex computer codes, Technometrics, 50, 527-541, (2008)
[23] Sacks, J.; Schiller, S., Spatial designs, (), 385-399
[24] Sacks, J.; Schiller, S.B.; Welch, W.J., Designs for computer experiments, Technometrics, 31, 41-47, (1989)
[25] Sacks, J.; Welch, W.J.; Mitchell, T.J.; Wynn, H.P., Designs and analysis of computer experiments (with discussion), Statistical science, 4, 409-435, (1989) · Zbl 0955.62619
[26] Shewry, M.C.; Wynn, H.P., Maximum entropy sampling, Journal of applied statistics, 14, 165-170, (1987)
[27] Sobol, I., On the systematic search in a hypercube, SIAM journal of numerical analysis, 16, 790-793, (1979) · Zbl 0445.65006
[28] Tang, B., Orthogonal array-based Latin hypercubes, Journal of the American statistical association, 88, 1392-1397, (1993) · Zbl 0792.62066
[29] Welch, W.J.; Buck, R.J.; Sacks, J.; Wynn, H.P.; Mitchell, T.J.; Morris, M.D., Screening, predicting, and computer experiments, Technometrics, 34, 15-25, (1992)
[30] Williams, B.J., Loeppky, J.L., Moore, L.M., Macklem, M.S., 2009. Batch sequential design to achieve predictive maturity with calibrated computer models. Technical Report, Los Alamos National Laboratory.
[31] Yi, T.-M., Fazel, M., Liu, X., Otitoju, T., Papachristodoulou, A., Prajna, S., Doyle., J., 2005. Application of robust model validation using SOSTOOLS to the study of G-protein signaling in yeast. In: Proceedings of Foundations of Systems Biology and Engineering.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.