×

Simulation optimization: a review of algorithms and applications. (English) Zbl 1317.90002

Summary: Simulation optimization refers to the optimization of an objective function subject to constraints, both of which can be evaluated through a stochastic simulation. To address specific features of a particular simulation – discrete or continuous decisions, expensive or cheap simulations, single or multiple outputs, homogeneous or heterogeneous noise – various algorithms have been proposed in the literature. As one can imagine, there exist several competing algorithms for each of these classes of problems. This document emphasizes the difficulties in simulation optimization as compared to algebraic model-based mathematical programming makes reference to state-of-the-art algorithms in the field, examines and contrasts the different approaches used, reviews some of the diverse applications that have been tackled by these methods, and speculates on future directions in the field.

MSC:

90-02 Research exposition (monographs, survey articles) pertaining to operations research and mathematical programming
65-02 Research exposition (monographs, survey articles) pertaining to numerical analysis
90C56 Derivative-free methods and methods using generalized derivatives
PDFBibTeX XMLCite
Full Text: DOI arXiv

References:

[1] Abramson MA (2007) NOMADm version 4.5 user’s guide. Air Force Institute of Technology, Wright-Patterson AFB, OH
[2] Alkhamis TM, Ahmed MA, Tuan VK (1999) Simulated annealing for discrete optimization with estimation. Eur J Oper Res 116:530-544 · Zbl 1009.90076
[3] Alrefaei MH, Andradóttir S (1999) A simulated annealing algorithm with constant temperature for discrete stochastic optimization. Manag Sci 45:748-764 · Zbl 1231.90315
[4] Ammeri A, Hachicha W, Chabchoub H, Masmoudi F (2011) A comprehensive literature review of mono-objective simulation optimization methods. Adv Prod Eng Manag 6(4):291-302 · Zbl 1272.90116
[5] Anderson EJ, Ferris MC (2001) A direct search algorithm for optimization with noisy function evaluations. SIAM J Optim 11:837-857 · Zbl 1035.90106
[6] Andradóttir, S.; Banks, J. (ed.), Chapter 9: Simulation optimization (1998), New York
[7] Andradóttir S (2006a) An overview of simulation optimization via random search. In: Henderson SG, Nelson BL (eds) Handbooks in operations research and management science: simulation, vol 13, chap 20. Elsevier, Amsterdam, pp 617-631
[8] Andradóttir S (2006b) Simulation optimization. In: Handbook of simulation: principles, methodology, advances, applications and practice. Wiley, New York, pp 307-333 · Zbl 0968.90054
[9] Andradóttir S, Kim SH (2010) Fully sequential procedures for comparing constrained systems via simulation. Naval Res Logist 57(5):403-421 · Zbl 1303.62114
[10] Angün E (2004) Black box simulation optimization: generalized response surface methodology. Ph.D. thesis, Tilburg University
[11] Angün E, Kleijnen JPC, Hertog DD, Gurkan G (2009) Response surface methodology with stochastic constraints for expensive simulation. J Oper Res Soc 60(6):735-746 · Zbl 1171.90554
[12] Ayvaz MT (2010) A linked simulation-optimization model for solving the unknown groundwater pollution source identification problems. J Contam Hydrol 117(1-4):46-59
[13] Azadivar F (1992) A tutorial on simulation optimization. In: Swain JJ, Goldsman D, Crain RC, Wilson JR (eds) Proceedings of the 1992 winter simulation conference, pp 198-204
[14] Azadivar J (1999) Simulation optimization methodologies. In: Farrington PA, Nembhard HB, Sturrock DT, Evans GW (eds) Proceedings of the 1999 winter simulation conference, pp 93-100
[15] Balakrishna R, Antoniou C, Ben-Akiva M, Koutsopoulos HN, Wen Y (2007) Calibration of microscopic traffic simulation models: methods and application. Transp Res Rec J Transp Res Board 1999(1):198-207
[16] Bangerth W, Klie H, Matossian V, Parashar M, Wheeler MF (2005) An autonomic reservoir framework for the stochastic optimization of well placement. Clust Comput 8(4):255-269
[17] Barton RR, Ivey JS Jr (1996) Nelder-Mead simplex modifications for simulation optimization. Manag Sci 42:954-973 · Zbl 0884.90118
[18] Barton, RR; Meckesheimer, M.; Henderson, S. (ed.); Nelson, B. (ed.), Metamodel-based simulation optimization, 535-574 (2006), Amsterdam
[19] Bechhofer RE, Santner TJ, Goldsman DM (1995) Design and analysis of experiments for statistical selection, screening, and multiple comparisons. Wiley, New York
[20] Bertsimas D, Tsitsiklis J (1993) Simulated annealing. Stat Sci 8(1):10-15
[21] Bettonvil B, del Castillo E, Kleijnen JPC (2009) Statistical testing of optimality conditions in multiresponse simulation-based optimization. Eur J Oper Res 199:448-458 · Zbl 1176.90434
[22] Bhatnagar S (2005) Adaptive multivariate three-timescale stochastic approximation algorithms for simulation based optimization. ACM Trans Model Comput Simul (TOMACS) 15(1):74-107 · Zbl 1390.65019
[23] Bianchi L, Dorigo M, Gambardella LM, Gutjahr WJ (2009) A survey on metaheuristics for stochastic combinatorial optimization. Nat Comput 8(2):239-287 · Zbl 1162.90591
[24] Birge JR, Louveaux F (2011) Introduction to stochastic programming, 2nd edn. Springer, Berlin · Zbl 1223.90001
[25] Box GEP, Wilson KB (1951) On the experimental attainment of optimum conditions. J R Stat Soc XII XIII(1):1-35 · Zbl 0043.34402
[26] Carson Y, Maria A (1997) Simulation optimization: Methods and applications. In: Andradóttir S, Healy KJ, Winters DH, Nelson BL (eds) Proceedings of the 1997 winter simulation conference, pp 118-126
[27] Chang KH (2008) Stochastic trust region response surface convergent method for continuous simulation optimization. Ph.D. thesis, Purdue University · Zbl 0873.90076
[28] Chang KH (2012) Stochastic Nelder-Mead simplex method-A new globally convergent direct search method for simulation optimization. Eur J Oper Res 220:684-694 · Zbl 1253.90178
[29] Chang KH, Hong LJ, Wan H (2013) Stochastic trust-region response-surface method (STRONG): a new response-surface framework for simulation optimization, vol 25(2), pp 230-243
[30] Chen CH (1995) An effective approach to smartly allocate computing budget for discrete event simulation. In: Proceedings of the 34th IEEE conference on decision and control, pp 2598-2605
[31] Chen CH (1996) A lower bound for the correct subset selection probability and its application to discrete event system simulations. IEEE Trans Autom Control 41:1227-1231 · Zbl 0868.93067
[32] Chen CH, Lee LH (2010) Stochastic simulation optimization: an optimal computing budget allocation. System engineering and operations research. World Scientific, Singapore
[33] Chen H, Schmeiser BW (1994) Retrospective optimization algorithms for stochastic root finding. In: Tew J, Manivannan S, Sadowski D, Seila A (eds) Proceedings of 1994 winter simulation conference, pp 255-261 · Zbl 1154.90626
[34] Chen CH, Yücesan E, Dai L, Chen HC (2009) Optimal budget allocation for discrete-event simulation experiments. IIE Trans 42(1):60-70
[35] Chick, SE; Henderson, SG (ed.); Nelson, BL (ed.), Subjective probability and bayesian methodology, No. 13, 225-257 (2006), Amsterdam
[36] Cho J, Dorfman KD (2010) Brownian dynamics simulations of electrophoretic DNA separations in a sparse ordered post array. J Chromatog A 1217:5522-5528
[37] Cohn DA, Ghahramani Z, Jordan MI (1996) Active learning with statistical models. J Artif Intell Res 4:129-145 · Zbl 0900.68366
[38] Collins NE, Eglese RW, Golden BL (1988) Simulated annealing—an annotated bibliography. Am J Math Manag Sci 8:209-308 · Zbl 0669.65047
[39] Conn AR, Gould NIM, Toint PL (2000) Trust-region methods. MOS-SIAM series on optimization · Zbl 0827.93009
[40] Conn AR, Scheinberg K, Vicente LN (2009) Introduction to derivative-free optimization. SIAM, Philadelphia · Zbl 1163.49001
[41] de Angelis V, Felici G, Impelluso P (2003) Integrating simulation and optimisation in health care centre management. Eur J Oper Res 150:101-114 · Zbl 1019.90510
[42] de Boer PT, Kroese DP, Mannor S, Rubinstein RY (2005) A tutorial on the cross-entropy method. Ann Oper Res 134:19-67 · Zbl 1075.90066
[43] Deng G (2007) Simulation-based optimization. Ph.D. thesis, University of Wisconsin-Madison
[44] Deng G, Ferris MC (2006) Adaptation of the UOBYQA algorithm for noisy functions. In: Perrone LF, Wieland FP, Liu J, Lawson BG, Nicol DM, Fujimoto RM (eds) Proceedings of the 2006 winter simulation conference, pp 312-319 · Zbl 1107.65049
[45] Deng G, Ferris MC (2007) Extension of the DIRECT optimization algorithm for noisy functions. In: Henderson SG, Biller B, Hsieh MH, Shortle J, Tew JD, Barton RR (eds) Proceedings of the 2007 winter simulation conference, pp 497-504
[46] Dengiz B, Akbay KS (2000) Computer simulation of a PCB production line: metamodeling approach. Int J Prod Econ 63(2):195-205
[47] Dhivya M, Sundarambal M, Anand LN (2011) Energy efficient computation of data fusion in wireless sensor networks using cuckoo-based particle approach (cbpa). Int J Commun Netw Syst Sci 4(4):249-255
[48] Dolan ED, Moré JJ (2002) Benchmarking optimization software with performance profiles. Math Program 91:201-213 · Zbl 1049.90004
[49] Dorigo M, Blum C (2005) Ant colony optimization theory: a survey. Theor Comput Sci 344(2-3):243-278 · Zbl 1154.90626
[50] Dorigo M, Stützle T (2004) Ant colony optimization. MIT Press, Cambridge · Zbl 1092.90066
[51] Driessen LT (2006) Simulation-based optimization for product and process design. Ph.D. thesis, Tilburg University
[52] Ernst D, Glavic M, Stan GB, Mannor S, Wehenkel L (2007) The cross-entropy method for power system combinatorial optimization problems. In: Power tech, pp 1290-1295. IEEE
[53] Ferris MC, Deng G, Fryback DG, Kuruchittham V (2005) Breast cancer epidemiology: calibrating simulations via optimization. Oberwolfach Rep 2:9023-9027 · Zbl 0049.36601
[54] Figueira G, Almada-Lobo B (2014) Hybrid simulation-optimization methods: a taxonomy. Simul Model Pract Theory 46:118-134
[55] Frazier PI (2009) Knowledge-gradient methods for statistical learning. Ph.D. thesis, Princeton University
[56] Frazier P, Powell W, Dayanik S (2009) The knowledge-gradient policy for correlated normal beliefs. INFORMS J Comput 21(4):599-613 · Zbl 1243.91014
[57] Fu MC (1994) Optimization via simulation: a review. Ann Oper Res 53:199-247 · Zbl 0833.90089
[58] Fu MC (2002) Optimization for simulation: theory vs practice. INFORMS J Comput 14(3):192-215 · Zbl 1238.90001
[59] Fu MC, Hill SD (1997) Optimization of discrete event systems via simulataneous perturbation stochastic approximation. IIE Trans 29(233-243)
[60] Fu MC, Hu JQ (1997) Conditional Monte Carlo: gradient estimation and optimization applications. Kluwer, Dordrecht
[61] Fu MC, Hu J, Marcus SI (1996) Model-based randomized methods for global optimization. In: Proceedings of the 17th international symposium on mathematical theory of networks and systems, Kyoto, Japan, pp 355-363
[62] Fu MC, Andradóttir S, Carson JS, Glover FW, Harrell CR, Ho YC, Kelly JP, Robinson SM (2000) Integrating optimization and simulation: research and practice. In: Joines JA, Barton RR, Kang K, Fishwick PA (eds) Proceedings of the 2000 winter simulation conference
[63] Fu MC, Glover FW, April J (2005) Simulation Optimization: a review, new developments, and applications. In: Kuhl ME, Steiger NM, Armstrong FB, Joines JA (eds) Proceedings of the 2005 winter simulation conference, pp 83-95 · Zbl 1098.90097
[64] Gendreau M, Potvin JY (2010) Tabu search. In: Handbook of metaheuristics, international series in operations research & management science, vol 146, 2nd ed. Springer, Berlin, pp 41-60
[65] Gerencsér L, Kozmann G, Vágó Z, Haraszti K (2002) The use of the SPSA method in ECG analysis. IEEE Trans Biomed Eng 49(10):1094-1101
[66] Gittins JC (1989) Multi-armed bandit allocation indices. Wiley-interscience series in systems and optimization. Wiley, New York
[67] Glasserman P (1991) Gradient estimation via perturbation analysis. Kluwer, Dordrecht · Zbl 0746.90024
[68] Glover F (1990) Tabu search: a tutorial. Interfaces 20(4):77-94
[69] Glover F, Hanafi S (2002) Tabu search and finite convergence. Discret Appl Math 119(1-2):3-36 · Zbl 0994.90116
[70] Glover F, Laguna M (1997) Tabu search. Kluwer, Boston · Zbl 0930.90083
[71] Glover F, Laguna M (2000) Fundamentals of scatter search and path relinking. Control Cybern 29(3):653-684 · Zbl 0983.90077
[72] Goldsman, D.; Nelson, BL; Banks, J. (ed.), Comparing systems via simulation (1998), New York
[73] Gong WB, Ho YC, Zhai W (2000) Stochastic comparison algorithm for discrete optimization with estimation. SIAM J Optim 10:384-404 (49) · Zbl 0957.60075
[74] Griewank A, Walther A (2008) Evaluating derivatives: principles and techniques of algorithmic differentiation, 2nd ed. No. 105 in other titles in applied mathematics. SIAM, Philadelphia, PA. http://www.ec-securehost.com/SIAM/OT105.html · Zbl 1159.65026
[75] Gürkan G, Ozge AY, Robinson SM (1994) Sample path optimization in simulation. In: Tew J, Manivannan S, Sadowski D, Seila A (eds) Proceedings of 1994 winter simulation conference, pp 247-254
[76] Hajek B (1988) Cooling schedules for optimal annealing. Math Oper Res 13:311-329 · Zbl 0652.65050
[77] Hall JD, Bowden RO, Usher JM (1996) Using evolution strategies and simulation to optimize a pull production system. J Mater Process Technol 61(1-2):47-52
[78] Hansen, N.; Lozano, JA (ed.); Larrañaga, P. (ed.); Inza, I. (ed.); Bengoetxea, E. (ed.), The CMA evolution strategy: a comparing review, 75-102 (2006), Berlin
[79] Hansen N (2011) The CMA Evolution strategy: a tutorial. http://www.lri.fr/hansen/cmaesintro.html
[80] Healy K, Schruben LW (1991) Retrospective simulation response optimization. In: Nelson BL, Kelton DW, Clark GM (eds) Proceedings of the 1991 winter simulation conference, pp 954-957
[81] Hill SD, Fu MC (1995) Transfer optimization via simultaneous perturbation stochastic approximation. In: Alexopoulos C, Kang K, Lilegdon WR, Goldsman D (eds) Proceedings of the 1995 winter simulation conference, pp 242-249
[82] Ho YC (1999) An explanation of ordinal optimization: soft computing for hard problems. Inf Sci 113:169-192 · Zbl 0931.90072
[83] Ho YC, Cao XR (1991) Discrete event dynamic systems and perturbation analysis. Kluwer, Dordrecht
[84] Hochberg Y, Tamhane AC (1987) Multiple comparison procedures. Wiley, New York · Zbl 0731.62125
[85] Hong LJ, Nelson BL (2006) Discrete optimization via simulation using COMPASS. Oper Res 54(1):115-129 · Zbl 1167.90630
[86] Hong LJ, Nelson BL (2009) A brief introduction to optimization via simulation. In: Rossetti MD, Hill RR, Johansson B, Dunkin A, Ingalls RG (eds) Proceedings of the 2009 winter simulation conference
[87] Hooke R, Jeeves TA (1961) Direct search solution of numerical and statistical problems. J Assoc Comput Mach 8:212-219 · Zbl 0111.12501
[88] Hsu JC (1996) Multiple comparisons: theory and methods. CRC Press, Boca Raton
[89] Hu J, Fu MC, Marcus SI (2005) Stochastic optimization using model reference adaptive search. In: Kuhl ME, Steiger NM, Armstrong FB, Joines JA (eds) Proceedings of the 2005 winter simulation conference, pp 811-818
[90] Hu J, Fu MC, Marcus SI (2007) A model reference adaptive search method for global optimization. Oper Res 55(3):549-568 · Zbl 1167.90690
[91] Huang D, Allen TT, Notz WI, Zeng N (2006) Global optimization of stochastic black-box systems via sequential kriging meta-models. J Glob Optim 34:441-466 · Zbl 1098.90097
[92] Humphrey DG, Wilson JR (2000) A revised simplex search procedure for stochastic simulation response-surface optimization. INFORMS J Comput 12(4):272-283 · Zbl 1238.90097
[93] Hunter SR, Pasupathy R (2013) Optimal sampling laws for stochastically constrained simulation optimization on finite sets. INFORMS J Comput 25(3):527-542 · Zbl 1238.90001
[94] Hutchison DW, Hill SD (2001) Simulation optimization of airline delay with constraints. In: Peters BA, Smith JS, Medeiros DJ, Rohrer MW (eds) Proceedings of the 2001 winter simulation conference, pp 1017-1022
[95] Huyer W, Neumaier A (2008) SNOBFIT—stable noisy optimization by branch and fit. ACM Trans Math Softw 35:1-25
[96] Irizarry MDLA, Wilson JR, Trevino J (2001) A flexible simulation tool for manufacturing-cell design, II: response surface analysis and case study. IIE Trans 33(10):837-846
[97] Jacobson SH, Schruben LW (1989) Techniques for simulation response optimization. Oper Res Lett 8:1-9
[98] Jia QS, Ho YC, Zhao QC (2006) Comparison of selection rules for ordinal optimization. Math Comput Model 43(9-10):1150-1171 · Zbl 1171.90487
[99] Jones DR, Perttunen CD, Stuckman BE (1993) Lipschitzian optimization without the Lipschitz constant. J Optim Theory Appl 79:157-181 · Zbl 0796.49032
[100] Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13:455-492 · Zbl 0917.90270
[101] Jung JY, Blau G, Pekny JF, Reklaitis GV, Eversdyk D (2004) A simulation based optimization approach to supply chain management under demand uncertainty. Comput Chem Eng 28:2087-2106
[102] Kabirian A (2009) Continuous optimization via simulation using golden region search. Ph.D. thesis, Iowa State University · Zbl 1208.90157
[103] Kabirian A, Ólafsson S (2007) Allocation of simulation runs for simulation optimization. In: Henderson SG, Biller B, Hsieh MH, Shortle J, Tew JD, Barton RR (eds) Proceedings of the 2007 winter simulation conference, pp 363-371
[104] Kabirian A, Ólafsson S (2011) Continuous optimization via simulation using golden region search · Zbl 1208.90157
[105] Kenne JP, Gharbi A (2001) A simulation optimization approach in production planning of failure prone manufacturing systems. J Intell Manuf 12:421-431
[106] Khan HA, Zhang Y, Ji C, Stevens CJ, Edwards DJ, O’Brien D (2006) Optimizing polyphase sequences for orthogonal netted radar. IEEE Signal Process Lett 13(10):589-592
[107] Kiefer J, Wolfowitz J (1952) Stochastic estimation of the maximum of a regression function. Ann Math Stat 23(3):462-466 · Zbl 0049.36601
[108] Kim SH (2005) Comparison with a standard via fully sequential procedures. ACM Trans Model Comput Simul (TOMACS) 15(2):155-174 · Zbl 1478.62130
[109] Kim, SH; Nelson, BL; Henderson, SG (ed.); Nelson, BL (ed.), Selecting the best system, 501-534 (2006), Amsterdam
[110] Kim SH, Nelson BL (2007) Recent advances in ranking and simulation. In: Henderson SG, Biller B, Hsieh MH, Shortle J, Tew JD, Barton RR (eds) Proceedings of the 2007 winter simulation conference, pp 162-172
[111] Kirkpatrick S, Gelatt CD, Vecchi MP (1983) Optimization by simulated annealing. Science 220:671-680 · Zbl 1225.90162
[112] Kleijnen JPC (1993) Simulation and optimization in production planning: a case study. Decis Support Syst 9:269-280
[113] Kleijnen JPC (2008) Design and analysis of simulation experiments. Springer, New York
[114] Kleijnen JPC (2009) Kriging metamodeling in simulation: a review. Eur J Oper Res 192(3):707-716 · Zbl 1157.90544
[115] Kleijnen JPC, van Beers WCM (2005) Robustness of kriging when interpolating in random simulation with heterogeneous variances: some experiments. Euro J Oper Res 165:826-834 · Zbl 1141.65330
[116] Kleijnen JPC, Beers WCM, van Nieuwenhuyse I (2012) Expected improvement in efficient global optimization through bootstrapped kriging. J Glob Optim 54(1):59-73 · Zbl 1254.90176
[117] Kleinman NL, Hill SD, Ilenda VA (1997) SPSA/SIMMOND optimization of air traffic delay cost. In: Proceedings of the 1997 American control conference, vol 2, pp 1121-1125
[118] Köchel P, Nieländer U (2005) Simulation-based optimisation of multi-echelon inventory systems. Int J Prod Econ 93-94:505-513
[119] Kolda TG, Lewis RM, Torczon VJ (2003) Optimization by direct search: new perspectives on some classical and modern methods. SIAM Rev 45:385-482 · Zbl 1059.90146
[120] Kothandaraman G, Rotea MA (2005) Simultaneous-perturbation-stochastic-approximation algorithm for parachute parameter estimation. J Aircr 42(5):1229-1235
[121] Kroese DP, Porotsky S, Rubinstein RY (2006) The cross-entropy method for continuous multi-extremal optimization. Methodol Comput Appl Probab 8(3):383-407 · Zbl 1107.65049
[122] Kroese DP, Hui KP, Nariai S (2007) Network reliability optimization via the cross-entropy method. IEEE Trans Reliab 56(2):275-287
[123] Kulturel-Konak S, Konak A (2010) Simulation optimization embedded particle swarm optimization for reliable server assignment. In: Johansson B, Jain S, Montoya-Torres J, Hugan J, Yücesan E (eds) Proceedings of the 2010 winter simulation conference, pp 2897-2906 · Zbl 0941.65061
[124] Larrañaga P, Lozano JA (2002) Estimation of distribution algorithms: a new tool for evolutionary computation. Kluwer, Dordrecht · Zbl 0979.00024
[125] Lau TWE, Ho YC (1997) Universal alignment probabilities and subset selection for ordinal optimization. J Optim Theory Appl 93(3):455-489 · Zbl 0873.90076
[126] Law AM, Kelton WD (2000) Simulation modeling and analysis, 3rd edn. McGraw-Hill, Singapore
[127] Lee LH, Pujowidianto NA, Li LW, Chen CH, Yap CM (2012) Approximate simulation budget allocation for selecting the best design in the presence of stochastic constraints. IEEE Trans Autom Control 57(11):2940-2945 · Zbl 1369.90202
[128] Li Y (2009) A simulation-based evolutionary approach to LNA circuit design optimization. Appl Math Comput 209(1):57-67 · Zbl 1158.94007
[129] Lucidi S, Sciandrone M (2002) On the global convergence of derivative-free methods for unconstrained minimization. SIAM J Optim 13:97-116 · Zbl 1027.90112
[130] Lutz CM, Davis KR, Sun M (1998) Determining buffer location and size in production lines using tabu search. Eur J Oper Res 106:301-316 · Zbl 0991.90046
[131] Martí R, Laguna M, Glover F (2006) Principles of scatter search. Eur J Oper Res 169(2):359-372 · Zbl 1079.90178
[132] Maryak JL, Chin DC (2008) Global random optimization by simulataneous perturbation stochastic approximation. IEEE Trans Autom Control 53:780-783 · Zbl 1367.65096
[133] Meketon MS (1987) Optimization in simulation: a survey of recent results. In: Thesen A, Grant H, Kelton WD (eds) Proceedings of the 1987 winter simulation conference, pp 58-67 · Zbl 0907.90250
[134] Merhof D, Soza G, Stadlbauer A, Greiner G, Nimsky C (2007) Correction of susceptibility artifacts in diffusion tensor data using non-linear registration. Med Image Anal 11(6):588-603
[135] Merton RC (1974) On the pricing of corporate debt: the risk structure of interest rates. J Financ 29(2):449-470
[136] Mishra V, Bhatnagar S, Hemachandra N (2007) Discrete parameter simulation optimization algorithms with applications to admission control with dependent service times. In: Proceedings of the 46th IEEE conference on decision and control, New Orleans, LA, pp 2986-2991
[137] Mockus J (1989) Bayesian approach to global optimization. Kluwer, Dordrecht · Zbl 0693.49001
[138] Mockus J, Tiesis V, Zilinskas A (1978) Towards global optimisation, vol. 2, chap. The application of Bayesian methods for seeking the extremum. North-Holland, Amsterdam · Zbl 0394.90090
[139] Moré J, Wild S (2009) Benchmarking derivative-free optimization algorithms. SIAM J Optim 20:172-191 · Zbl 1187.90319
[140] Myers RH, Montgomery DC, Anderson-Cook CM (2009) Response surface methodology: process and product optimization using designed experiments. wiley series in probability and statistics. Wiley, New York
[141] Neddermeijer HG, Oortmarssen GJV, Piersma N, Dekker R (2000) A framework for response surface methodology for simulation optimization. In: Joines JA, Barton RR, Kang K, Fishwick PA (eds) Proceedings of the 2000 winter simulation conference, pp 129-136 · Zbl 0711.90091
[142] Nelder JA, Mead R (1965) A simplex method for function minimization. Comput J 7:308-313 · Zbl 0229.65053
[143] Nelson BL (2010) Optimization via simulation over discrete decision variables. Tutor Oper Res 7:193-207
[144] Nelson BL, Goldsman D (2001) Comparisons with a standard in simulation experiments. Manag Sci 47(3):449-463
[145] Nicolai R, Dekker R (2009) Automated response surface methodology for simulation optimization models with unknown variance. Qual Technol Qual Manag 6(3):325-352
[146] Ólafsson, S.; Henderson, S. (ed.); Nelson, B. (ed.), Metaheuristics, 633-654 (2006), Amsterdam
[147] Osorio C, Bierlaire M (2010) A simulation-based optimization approach to perform urban traffic control. In: Proceedings of the triennial symposium on transportation analysis
[148] Pasupathy R, Ghosh S (2013) Simulation optimization: a concise overview and implementation guide. Tutor Oper Res 10:122-150
[149] Pasupathy R, Henderson SG (2011) SIMOPT: a library of simulation-optimization problems. In: Jain S, Creasey RR, Himmelspach J, White KP, Fu M (eds) Proceedings of the 2011 winter simulation conference
[150] Pasupathy R, Kim S (2011) The stochastic root finding problem: overview, solutions, and open questions. ACM Trans Model Comput Simul (TOMACS) 21(3):19:1-19:23 · Zbl 1386.65054
[151] Peters J, Vijayakumar S, Schaal S (2003) Reinforcement learning for humanoid robotics. In: Third IEEE-RAS international conference on humanoid robots, Karlsruhe, Germany, pp 1-20 · Zbl 1225.90162
[152] Pflug GC (1996) Optimization of stochastic models: the interface between simulation and optimization. Kluwer, Dordrecht · Zbl 0909.90220
[153] Plambeck EL, Fu BR, Robinson SM, Suri R (1996) Sample-path optimization of convex stochastic performance functions. Math Program 75(2):137-176 · Zbl 0874.90150
[154] Powell WB (2013) http://www.castlelab.princeton.edu/cso.htm. Accessed 23 Oct 2013
[155] Powell WB, Ryzhov IO (2012) Optimal learning. Wiley, New York
[156] Prakash P, Deng G, Converse MC, Webster JG, Mahvi DM, Ferris MC (2008) Design optimization of a robust sleeve antenna for hepatic microwave ablation. Phys Med Biol 53:1057-1069
[157] Radac MB, Precup RE, Petriu EM, Preitl S (2011) Application of ift and SPSA to servo system control. IEEE Trans Neural Netw 22(12):2363-2375
[158] Rall, LB (1981) Automatic differentiation: techniques and applications, lecture notes in computer science, vol 120. Springer, Berlin. doi:10.1007/3-540-10861-0
[159] Ramanathan SP, Mukherjee S, Dahule RK, Ghosh S, Rahman I, Tambe SS, Ravetkar DD, Kulkarni BD (2001) Optimization of continuous distillation columns using stochastic optimization approaches. Trans Inst Chem Eng 79:310-322
[160] Rasmussen CE, Williams CKI (2006) Gaussian processes for machine learning. MIT Press, Cambridge
[161] Reeves CR (1997) Genetic algorithms for the operations researcher. INFORMS J Comput 9(3):231-250 · Zbl 0893.90145
[162] Renotte C, Vande Wouwer A (2003) Stochastic approximation techniques applied to parameter estimation in a biological model. In: Proceedings of the second IEEE international workshop on Intelligent data acquisition and advanced computing systems: technology and applications, 2003, IEEE, pp 261-265 · Zbl 1052.62082
[163] Rios LM, Sahinidis NV (2013) Derivative-free optimization: a review of algorithms and comparison of software implementations. J Glob Optim 56:1247-1293 · Zbl 1272.90116
[164] Robbins H, Monro S (1951) A stochastic approximation method. Ann Math Stat 22(3):400-407 · Zbl 0054.05901
[165] Robinson SM (1996) Analysis of sample-path optimization. Math Oper Res 21(3):513-528 · Zbl 0868.90087
[166] Romero PA, Krause A, Arnold FH (2013) Navigating the protein fitness landscape with gaussian processes. Proc Natl Acad Sci (PNAS) 110(3). doi:10.1073/pnas.1215251110 · Zbl 1292.92015
[167] Roustant O, Ginsbourger D, Deville Y (2012) Dicekriging, diceoptim: two r packages for the analysis of computer experiments by kriging-based metamodeling and optimization. J Stat Softw 51(1):1-55
[168] Rubinstein R (1999) The cross-entropy method for combinatorial and continuous optimization. Methodol Comput Appl Probab 1:127-190 · Zbl 0941.65061
[169] Rubinstein RY, Kroese DP (2004) The cross-entropy method: a unified approach to combinatorial optimization, Monte-Carlo simulation, and machine learning. Springer, New York · Zbl 1140.90005
[170] Rubinstein RY, Shapiro A (1993) Discrete event systems: sensitivity analysis and stochastic optimization by the score function method. Wiley, New York · Zbl 0805.93002
[171] Sacks J, Schiller SB, Welch WJ (1989) Designs for computer experiments. Technometrics 31:41-47
[172] Safizadeh MH (1990) Optimization in simulation: current issues and the future outlook. Naval Res Logist 37:807-825 · Zbl 0711.90091
[173] Sahinidis NV (2004) Optimization under uncertainty: State-of-the-art and opportunities. Comput Chem Eng 28(6-7):971-983
[174] Schwartz JD, Wang W, Rivera DE (2006) Simulation-based optimization of process control policies for inventory management in supply chains. Automatica 42:1311-1320 · Zbl 1097.90007
[175] Scott W, Frazier PI, Powell W (2011) The correlated knowledge gradient for simulation optimization of continuous parameters using gaussian process regression. SIAM J Optim 21(3):996-1026 · Zbl 1229.62018
[176] Settles B (2010) Active learning literature survey. Tech. rep., University of Wisconsin-Madison
[177] Shapiro A (1991) Asymptotic analysis of stochastic programs. Ann Oper Res 30:169-186 · Zbl 0745.90057
[178] Shapiro A (1996) Simulation based optimization. In: Charnes JM, Morrice DJ, Brunner DT, Swain JJ (eds) Proceedings of the 1996 winter simulation conference, pp 332-336
[179] Shi L, Ólafsson S (2000) Nested partitions method for stochastic optimization. Methodol Comput Appl Probab 2:271-291 · Zbl 0968.90054
[180] Shi L, Ólafsson (2007) Nested partitions optimization: methodology and applications, international series in operations research & management science, vol 109. Springer, Berlin
[181] Song Y, Grizzle JW (1995) The extended kalman filter as a local asymptotic observer for discrete-time nonlinear systems. J Math Syst Estim Control 5(1):59-78 · Zbl 0827.93009
[182] Spall JC (1992) Multivariate stochastic approximation using a simultaneous perturbation gradient approximation. IEEE Trans Autom Control 37:332-341 · Zbl 0745.60110
[183] Spall JC (2003) Introduction to stochastic search and optimization: Estimation, simulation, and control. Wiley-Interscience · Zbl 1088.90002
[184] Spall JC (2009) Feedback and weighting mechanisms for improving Jacobian estimates in the adaptive simultaneous perturbation algorithm. IEEE Trans Autom Control 54(6):1216-1229 · Zbl 1367.93734
[185] Spall, JC; Gentle, JE (ed.); Härdle, WK (ed.); Mori, Y. (ed.), Stochastic optimization, 173-201 (2012), Berlin
[186] Srinivas N, Krause A, Kakade SM, Seeger M (2012) Information-theoretic regret bounds for gaussian process optimization in the bandit setting. IEEE Trans Inf Theory 58(5):3250-3265 · Zbl 1365.94131
[187] Stephens CP, Baritompa W (1998) Global optimization requires global information. J Optim Theory Appl 96:575-588 · Zbl 0907.90250
[188] Swisher JR, Hyden PD, Jacobson SH, Schruben LW (2000) A survey of simulation optimization techniques and procedures. In: Joines JA, Barton RR, Kang K, Fishwick PA (eds) Proceedings of the 2000 winter simulation conference
[189] Syberfeldt A, Lidberg S (2012) Real-world simulation-based manufacturing optimization using cuckoo search. In: Laroque C, Himmelspach J, Pasupathy R, Rose O, Uhrmacher A (eds) Proceedings of the 2012 winter simulation conference
[190] Tein LH, Ramli R (2010) Recent advancements of nurse scheduling models and a potential path. In: Proceedings of the 6th IMT-GT conference on mathematics, statistics and its applications, pp 395-409
[191] Tekin E, Sabuncuoglu I (2004) Simulation optimization: a comprehensive review on theory and applications. IIE Trans 36:1067-1081
[192] Teng S, Lee LH, Chew EP (2007) Multi-objective ordinal optimization for simulation optimization problems. Automatica 43(11):1884-1895 · Zbl 1162.90553
[193] Trosset MW (2000) On the use of direct search methods for stochastic optimization. Tech. rep., Rice University, Houston, TX
[194] van Beers AC, Kleijnen JPC (2004) Kriging interpolation in simulation: a survey. In: Proceedings of the 2004 winter simulation conference, vol 1, pp 121-129
[195] Vande Wouwer A, Renotte, Bogaerts P, Remy M (2001) Application of SPSA techniques in nonlinear system identification. In: Proceedings of the European control conference, p 2835 · Zbl 1130.65008
[196] Wang Q, Spall JC (2011) Discrete simultaneous perturbation stochastic approximation on loss functions with noisy measurements. In: Proceedings of the American control conference. IEEE, San Francisco, pp 4520-4525
[197] Wang H, Pasupathy R, Schmeiser BW (2012) Integer-ordered simulation optimization using R-SPLINE: retrospective search with piecewise-linear interpolation and neighborhood enumeration. ACM Trans Model Comput Simul (TOMACS) 23:17:1-17:24 · Zbl 1386.65167
[198] Whitley D (1994) A genetic algorithm tutorial. Stat Comput 4:65-85
[199] Xie J, Frazier PI (2013) Sequential bayes-optimal policies for multiple comparisons with a known standard. Oper Res 61(5):1174-1189 · Zbl 1291.90155
[200] Xie J, Frazier PI, Sankaran S, Marsden A, Elmohamed S (2012) Optimization of computationally expensive simulations with gaussian processes and parameter uncertainty: application to cardiovascular surgery. In: 50th Annual allerton conference on communication, control, and computing
[201] Xing XQ, Damodaran M (2002) Assessment of simultaneous perturbation stochastic approximation method for wing design optimization. J Aircr 39:379-381
[202] Xing XQ, Damodaran M (2005a) Application of simultaneous perturbation stochastic approximation method for aerodynamic shape design optimization. AIAA J 43(2):284-294 · Zbl 1291.90155
[203] Xing XQ, Damodaran M (2005b) Inverse design of transonic airfoils using parallel simultaneous perturbation stochastic approximation. J Aircr 42(2):568-570
[204] Xu J, Nelson BL, Hong LJ (2010) Industrial strength COMPASS: a comprehensive algorithm and software for optimization via simulation. ACM Trans Model Comput Simul (TOMACS) 20(1):1-29 · Zbl 1386.65034
[205] Xu J, Nelson BL, Hong LJ (2013) An adaptive hypberbox algorithm for high-dimensional discrete optimization via simulation problems. INFORMS J Comput 25(1):133-146
[206] Yalçinkaya Ö, Mirac Bayhan G (2009) Modelling and optimization of average travel time for a metro line by simulation and response surface methodology. Eur J Oper Res 196:225-233 · Zbl 1155.90328
[207] Yan D, Mukai H (1992) Stochastic discrete optimization. SIAM J Control Optim 30:594-612 · Zbl 0764.90066
[208] Yang XS, Deb S (2010) Engineering optimisation by cuckoo search. Int J Math Model Numer Optim 1(4):330-343 · Zbl 1279.90204
[209] Yeomans JS (2007) Solid waste planning under uncertainty using evolutionary simulation-optimization. Socio-Econ Plan Sci 41:38-60
[210] Yun I, Park B (2010) Application of stochastic optimization method for an urban corridor. In: Perrone LF, Wieland FP, Liu J, Lawson BG, Nicol DM, Fujimoto RM (eds) Proceedings of the 2010 winter simulation conference, pp 1493-1499
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.