A local search method for costly black-box problems and its application to CSP plant start-up optimization refinement. (English) Zbl 1457.90155

Summary: A variety of engineering applications are tackled as black-box optimization problems where a computationally expensive and possibly noisy function is optimized over a continuous domain. In this paper we present a derivative-free local method which is well-suited for such problems, and we describe its application to the optimization of the start-up phase of an innovative Concentrated Solar Power (CSP) plant. The method, referred to as rqlif, exploits a regularized quadratic model and a linear implicit filtering strategy so as to be parsimonious in terms of function evaluations. After assessing the performance of rqlif on a set of analytical test problems in comparison with three well-known local algorithms, we apply it in conjunction with a global algorithm based on RBFs interpolation to the start-up optimization of the CSP plant developed in the PreFlexMS H2020 project. For the test problems, rqlif provides good quality solutions in a limited number of function evaluations. For the application, the global-local strategy yields a substantial improvement with respect to the reference solution and significantly reduces the thermo-mechanical stress suffered by the plant components.


90C30 Nonlinear programming
90C56 Derivative-free methods and methods using generalized derivatives
90C90 Applications of mathematical programming
Full Text: DOI


[1] Abramson, MA; Audet, C.; Dennis, JE Jr; Digabel, SL, OrthoMADS: a deterministic MADS instance with orthogonal directions, SIAM J Optim, 20, 2, 948-966 (2009) · Zbl 1189.90202
[2] Aga, V.; Peruchena, CF, PreFlexMS: predictable flexible molten salts solar power plants, Impact, 3, 58-60 (2017)
[3] Audet, C.; Dennis, JE Jr, Mesh adaptive direct search algorithms for constrained optimization, SIAM J Optim, 17, 1, 188-217 (2006) · Zbl 1112.90078
[4] Audet, C.; Hare, W., Derivative-free and blackbox optimization (2017), New York: Springer, New York · Zbl 1391.90001
[5] Audet, C.; Kokkolaras, M., Blackbox and derivative-free optimization: theory, algorithms and applications, Optim Eng, 177, 1-2 (2016) · Zbl 1364.90008
[6] Boukouvala, F.; Hasan, MF; Floudas, CA, Global optimization of general constrained grey-box models: new method and its application to constrained PDEs for pressure swing adsorption, J Global Optim, 67, 1-2, 3-42 (2017) · Zbl 1359.90101
[7] Cammi, A.; Casella, F.; Ricotti, ME; Schiavo, F., An object-oriented approach to simulation of iris dynamic response, Prog Nucl Energy, 53, 1, 48-58 (2011)
[8] Campana, EF; Liuzzi, G.; Lucidi, S.; Peri, D.; Piccialli, V.; Pinto, A., New global optimization methods for ship design problems, Optim Eng, 10, 4, 533 (2009) · Zbl 1273.74383
[9] Campana, EF; Diez, M.; Iemma, U.; Liuzzi, G.; Lucidi, S.; Rinaldi, F.; Serani, A., Derivative-free global ship design optimization using global/local hybridization of the direct algorithm, Optim Eng, 17, 1, 127-156 (2016) · Zbl 1365.90213
[10] Capra, F.; Gazzani, M.; Joss, L.; Mazzotti, M.; Martelli, E., MO-MCS, a derivative-free algorithm for the multiobjective optimization of adsorption processes, Ind Eng Chem Res, 57, 9977-9993 (2018)
[11] Casella, F.; Leva, A., Modelling of thermo-hydraulic power generation processes using modelica, Math Comp Model Dyn, 12, 1, 19-33 (2006)
[12] Casella F, Trabucchi S (2016) Object-oriented modelling and simulation of a molten-salt once-through steam generator for solar applications using open-source tools. In: 9th Eurosim congress on modelling and simulation EUROSIM 2016, IFAC, pp 1-6
[13] Casella F, Farina M, Righetti F, Scattolini R, Faille D, Davelaar F, Tica A, Guéguen H, Dumur D, et al. (2011) An optimization procedure of the start-up of combined cycle power plants. In: 18th IFAC World Congress, IFAC, pp 7043-7048
[14] Casella, F.; Mathijssen, T.; Colonna, P.; van Buijtenen, J., Dynamic modeling of organic rankine cycle power systems, J Eng Gas Turb Power, 135, 4, 042310 (2013)
[15] Cervantes, A.; Biegler, LT, Large-scale DAE optimization using a simultaneous NLP formulation, AIChE J, 44, 5, 1038-1050 (1998)
[16] Cervantes, A.; Biegler, LT; Floudas, CA; Pardalos, PM, Optimization strategies for dynamic systems, Encyclopedia of optimization, 2847-2858 (2008), New York: Springer, New York
[17] Cervantes, AM; Biegler, LT, A stable elemental decomposition for dynamic process optimization, J Comput Appl Math, 120, 1-2, 41-57 (2000) · Zbl 0970.65071
[18] Choi, T.; Kelley, CT, Superlinear convergence and implicit filtering, SIAM J Optim, 10, 4, 1149-1162 (2000) · Zbl 0994.65071
[19] Cochran JJ, Cox Jr LA, Keskinocak P, Kharoufeh JP, Cole Smith J (2010) Direct search methods. Wiley Encyclopedia of Operations Research and Management Science. 10.1002/9780470400531
[20] Conn, AR; Scheinberg, K.; Toint, PL; Buhmann, MD; Powell, MJD; Buhmann, MD; Iserles, A., On the convergence of derivative-free methods for unconstrained optimization, Approximation theory and optimization: tributes to MJD Powell, 83-108 (1997), Cambridge: Cambridge University Press, Cambridge
[21] Conn, AR; Scheinberg, K.; Toint, PL, Recent progress in unconstrained nonlinear optimization without derivatives, Math Program, 79, 1-3, 397 (1997) · Zbl 0887.90154
[22] Conn, AR; Gould, NI; Toint, P., Trust region methods (2000), Philadelphia: SIAM, Philadelphia · Zbl 0958.65071
[23] Conn, AR; Scheinberg, K.; Vicente, LN, Introduction to derivative-free optimization (2009), Philadelphia: SIAM, Philadelphia
[24] Costa, A.; Nannicini, G.; Schroepfer, T.; Wortmann, T.; Cardin, M-A; Krob, D.; Lui, PC; Tan, YH; Wood, K., Black-box optimization of lighting simulation in architectural design, Complex systems design & management Asia, 27-39 (2015), New York: Springer, New York
[25] Custódio, AL; Vicente, LN, Using sampling and simplex derivatives in pattern search methods, SIAM J Optim, 18, 2, 537-555 (2007) · Zbl 1144.65039
[26] De Boor, C.; De Boor, C.; Mathématicien, EU; De Boor, C.; De Boor, C., A practical guide to splines (1978), New York: Springer, New York · Zbl 0406.41003
[27] De Leone, R.; Gaudioso, M.; Grippo, L., Stopping criteria for linesearch methods without derivatives, Math Program, 30, 3, 285-300 (1984) · Zbl 0576.90087
[28] Dolan, ED; Moré, JJ, Benchmarking optimization software with performance profiles, Math Program, 91, 2, 201-213 (2002) · Zbl 1049.90004
[29] Faille, D.; Davelaar, F., Model based start-up optimization of a combined cycle power plant, IFAC Proc, 42, 9, 197-202 (2009)
[30] Fasano, G.; Morales, JL; Nocedal, J., On the geometry phase in model-based algorithms for derivative-free optimization, Optim Method Softw, 24, 1, 145-154 (2009) · Zbl 1154.90589
[31] Fritzson, P.; Aronsson, P.; Lundvall, H.; Nyström, K.; Pop, A.; Saldamli, L.; Broman, D., The openmodelica modeling, simulation, and software development environment, Simul News Eur, 44, 8-16 (2005)
[32] Gilmore, P.; Kelley, CT, An implicit filtering algorithm for optimization of functions with many local minima, SIAM J Optim, 5, 2, 269-285 (1995) · Zbl 0828.65064
[33] Gould, NI; Orban, D.; Toint, PL, CUTEr and SifDec: a constrained and unconstrained testing environment, revisited, ACM Trans Math Softw (TOMS), 29, 4, 373-394 (2003) · Zbl 1068.90526
[34] Grippo, L.; Lampariello, F.; Lucidi, S., Global convergence and stabilization of unconstrained minimization methods without derivatives, J Optim Theory App, 56, 3, 385-406 (1988) · Zbl 0619.90063
[35] Gutmann, HM, A radial basis function method for global optimization, J Global Optim, 19, 3, 201-227 (2001) · Zbl 0972.90055
[36] Hellstrom, T.; Holmström, K., Parameter tuning in trading algorithms using ASTA, Comput Finance, 1, 343-357 (1999)
[37] Hestenes, MR, Conjugate direction methods in optimization (2012), New York: Springer, New York
[38] Ho, CK, Advances in central receivers for concentrating solar applications, Sol Energy, 152, 38-56 (2017)
[39] Holmström K (1999) The TOMLAB optimization environment in Matlab. https://tomopt.com/ · Zbl 1115.90404
[40] Holmström K (2005) An Adaptive Radial Basis Algorithm (ARBF) for Mixed-Integer Expensive Constrained Global Optimization. In: International workshop on global optimization, pp 133-140
[41] Holmström, K., An adaptive radial basis algorithm (ARBF) for expensive black-box global optimization, J Global Optim, 41, 3, 447-464 (2008) · Zbl 1152.90609
[42] Hooke, R.; Jeeves, TA, “Direct search” solution of numerical and statistical problems, J ACM, 8, 2, 212-229 (1961) · Zbl 0111.12501
[43] Huyer, W.; Neumaier, A., Global optimization by multilevel coordinate search, J Global Optim, 14, 4, 331-355 (1999) · Zbl 0956.90045
[44] Jones, DR; Schonlau, M.; Welch, WJ, Efficient global optimization of expensive black-box functions, J Global Optim, 13, 4, 455-492 (1998) · Zbl 0917.90270
[45] Kelley, C., Detection and remediation of stagnation in the Nelder-Mead algorithm using a sufficient decrease condition, SIAM J Optim, 10, 1, 43-55 (1999) · Zbl 0962.65048
[46] Kelley, CT, Iterative methods for optimization (1999), Philadelphia: SIAM, Philadelphia
[47] Kolda, TG; Lewis, RM; Torczon, V., Optimization by direct search: new perspectives on some classical and modern methods, SIAM Rev, 45, 3, 385-482 (2003) · Zbl 1059.90146
[48] Krüger, K.; Franke, R.; Rode, M., Optimization of boiler start-up using a nonlinear boiler model and hard constraints, Energy, 29, 12-15, 2239-2251 (2004)
[49] Le Besnerais, J.; Fasquelle, A.; Lanfranchi, V.; Hecquet, M.; Brochet, P., Mixed-variable optimal design of induction motors including efficiency, noise and thermal criteria, Optim Eng, 12, 1-2, 55-72 (2011) · Zbl 1220.78121
[50] Le Digabel, S., Algorithm 909: NOMAD: nonlinear optimization with the MADS algorithm, ACM Trans Math Software (TOMS), 37, 4, 1-15 (2011) · Zbl 1365.65172
[51] Liuzzi, G.; Lucidi, S.; Piccialli, V., Exploiting derivative-free local searches in direct-type algorithms for global optimization, Comput Optim Appl, 65, 2, 449-475 (2016) · Zbl 1370.90194
[52] Lovegrove, K.; Stein, W., Concentrating solar power technology: principles, developments and applications (2012), Amsterdam: Elsevier, Amsterdam
[53] Lucidi, S.; Sciandrone, M., A derivative-free algorithm for bound constrained optimization, Comput Optim Appl, 21, 2, 119-142 (2002) · Zbl 0988.90033
[54] Lucidi, S.; Sciandrone, M., On the global convergence of derivative-free methods for unconstrained optimization, SIAM J Optim, 13, 1, 97-116 (2002) · Zbl 1027.90112
[55] Luus, R., Piecewise linear continuous optimal control by iterative dynamic programming, Ind Eng Chem Res, 32, 5, 859-865 (1993)
[56] Madsen, JI; Langthjem, M., Multifidelity response surface approximations for the optimum design of diffuser flows, Optim Eng, 2, 4, 453-468 (2001) · Zbl 1014.62095
[57] Martelli, E.; Amaldi, E., PGS-COM: a hybrid method for constrained non-smooth black-box optimization problems: brief review, novel algorithm and comparative evaluation, Comput Chem Eng, 63, 108-139 (2014)
[58] Meo, M.; Zumpano, G., Damage assessment on plate-like structures using a global-local optimization approach, Optim Eng, 9, 2, 161-177 (2008) · Zbl 1175.74066
[59] Misener, R.; Floudas, CA, ANTIGONE: algorithms for continuous/integer global optimization of nonlinear equations, J Global Optim, 59, 2-3, 503-526 (2014) · Zbl 1301.90063
[60] Moré, JJ; Wild, SM, Benchmarking derivative-free optimization algorithms, SIAM J Optim, 20, 1, 172-191 (2009) · Zbl 1187.90319
[61] Nelder, JA; Mead, R., A simplex method for function minimization, Comput J, 7, 4, 308-313 (1965) · Zbl 0229.65053
[62] Olivero, M.; Pasquale, D.; Ghidoni, A.; Rebay, S., Three-dimensional turbulent optimization of vaned diffusers for centrifugal compressors based on metamodel-assisted genetic algorithms, Optim Eng, 15, 4, 973-992 (2014)
[63] Peeters, J.; Louarroudi, E.; Bogaerts, B.; Sels, S.; Dirckx, J.; Steenackers, G., Active thermography setup updating for nde: a comparative study of regression techniques and optimisation routines with high contrast parameter influences for thermal problems, Optim Eng, 19, 1, 163-185 (2018)
[64] Pontryagin, LS, Mathematical theory of optimal processes (2018), Abingdon: Routledge, Abingdon
[65] Porcelli, M.; Toint, PL, BFO, a trainable derivative-free brute force optimizer for nonlinear bound-constrained optimization and equilibrium computations with continuous and discrete variables, ACM Trans Math Software, 44, 1, 6 (2017) · Zbl 06920068
[66] Powell, MJ; Gomez, S.; Hennart, J-P, A direct search optimization method that models the objective and constraint functions by linear interpolation, Advances in optimization and numerical analysis, 51-67 (1994), Berlin: Springer, Berlin · Zbl 0826.90108
[67] Powell, MJ; Müller, MW; Buhmann, MD; Mache, D.; Felten, M., Recent research at Cambridge on radial basis functions, New developments in approximation theory, 215-232 (1999), New York: Springer, New York
[68] Powell, MJ, UOBYQA: unconstrained optimization by quadratic approximation, Math Program, 92, 3, 555-582 (2002) · Zbl 1014.65050
[69] Powell, MJ; Di Pillo, G.; Roma, M., The NEWUOA software for unconstrained optimization without derivatives, Large-scale nonlinear optimization, 255-297 (2006), Berlin: Springer, Berlin · Zbl 1108.90005
[70] Rios, LM; Sahinidis, NV, Derivative-free optimization: a review of algorithms and comparison of software implementations, J Global Optim, 56, 3, 1247-1293 (2013) · Zbl 1272.90116
[71] Schulz, VH; Bock, HG; Steinbach, MC, Exploiting invariants in the numerical solution of multipoint boundary value problems for dae, SIAM J Sci Comput, 19, 2, 440-467 (1998) · Zbl 0947.65096
[72] Stoppato, A.; Mirandola, A.; Meneghetti, G.; Casto, EL, On the operation strategy of steam power plants working at variable load: technical and economic issues, Energy, 37, 1, 228-236 (2012)
[73] Taler, J.; Dzierwa, P.; Taler, D.; Harchut, P., Optimization of the boiler start-up taking into account thermal stresses, Energy, 92, 160-170 (2015)
[74] Tseng, P., Fortified-descent simplicial search method: a general approach, SIAM J Optim, 10, 1, 269-288 (1999) · Zbl 1030.90122
[75] Vassiliadis, V.; Sargent, R.; Pantelides, C., Solution of a class of multistage dynamic optimization problems. 1. Problems without path constraints, Ind Eng Chem Res, 33, 9, 2111-2122 (1994)
[76] Vassiliadis, V.; Sargent, R.; Pantelides, C., Solution of a class of multistage dynamic optimization problems. 2. Problems with path constraints, Ind Eng Chem Res, 33, 9, 2123-2133 (1994)
[77] Wetter, M.; Wright, J., A comparison of deterministic and probabilistic optimization algorithms for nonsmooth simulation-based optimization, Build Environ, 39, 8, 989-999 (2004)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.