×

Applying the pattern search implicit filtering algorithm for solving a noisy problem of parameter identification. (English) Zbl 1446.90147

Summary: Our contribution in this paper is twofold. First, the global convergence analysis of the recently proposed pattern search implicit filtering algorithm (PSIFA), aimed at linearly constrained noisy minimization problems, is revisited to address more general locally Lipschitz objective functions corrupted by noise. Second, PSIFA is applied for solving the damped harmonic oscillator parameter identification problem. This problem can be formulated as a linearly constrained optimization problem, for which the constraints are related to the features of the damping. Such a formulation rests upon a very expensive objective function whose evaluation comprises the numerical solution of an ordinary differential equation (ODE), with intrinsic numerical noise. Computational experimentation encompasses distinct choices for the ODE solvers, and a comparative analysis of the most effective options against the pattern search and the implicit filtering algorithms.

MSC:

90C30 Nonlinear programming
90C56 Derivative-free methods and methods using generalized derivatives
65K05 Numerical mathematical programming methods
49M37 Numerical methods based on nonlinear programming
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Audet, C.; Dennis, JE Jr, Mesh adaptive direct search algorithms for constrained optimization, SIAM J. Optim., 17, 1, 188-217 (2006) · Zbl 1112.90078 · doi:10.1137/040603371
[2] Audet, C.; Dennis, JE Jr, A progressive barrier for derivative-free nonlinear programming, SIAM J. Optim., 20, 1, 445-472 (2009) · Zbl 1187.90266 · doi:10.1137/070692662
[3] Audet, C.; Hare, W., Derivative-Free and Blackbox Optimization. Springer Series in Operations Research and Financial Engineering (2017), Cham: Springer International Publishing, Cham · Zbl 1391.90001
[4] Bertsekas, DP, Nonlinear Programming (1999), Belmont: Athena Scientific, Belmont · Zbl 1015.90077
[5] Clarke, FH, Optimization and Nonsmooth Analysis (1990), Philadelphia: SIAM, Philadelphia · Zbl 0696.49002
[6] Conn, AR; Scheinberg, K.; Vicente, LN, Introduction to Derivative-Free Optimization (2009), Philadelphia: SIAM, Philadelphia · Zbl 1163.49001
[7] Custódio, AL; Dennis, JE Jr; Vicente, LN, Using simplex gradients of nonsmooth functions in direct search methods, IMA J. Numer. Anal., 28, 4, 770-784 (2008) · Zbl 1156.65059 · doi:10.1093/imanum/drn045
[8] Custódio, AL; Vicente, LN, Using sampling and simplex derivatives in pattern search methods, SIAM J. Optim., 18, 2, 537-555 (2007) · Zbl 1144.65039 · doi:10.1137/050646706
[9] Diniz-Ehrhardt, MA; Ferreira, DG; Santos, SA, A pattern search and implicit filtering algorithm for solving linearly constrained minimization problems with noisy objective functions, Optim. Methods Softw., 34, 4, 827-852 (2019) · Zbl 1415.90148 · doi:10.1080/10556788.2018.1464570
[10] Diniz-Ehrhardt, MA; Martínez, JM; Raydan, M., A derivative-free nonmonotone line-search technique for unconstrained optimization, J. Comput. Appl. Math., 219, 2, 383-397 (2008) · Zbl 1149.65041 · doi:10.1016/j.cam.2007.07.017
[11] Dolan, ED; Moré, JJ, Benchmarking optimization software with performance profiles, Math. Program., 91, 2, 201-213 (2002) · Zbl 1049.90004 · doi:10.1007/s101070100263
[12] Fasano, G.; Liuzzi, G.; Lucidi, S.; Rinaldi, F., A linesearch-based derivative-free approach for nonsmooth constrained optimization, SIAM J. Optim., 24, 3, 959-992 (2014) · Zbl 1302.90207 · doi:10.1137/130940037
[13] Finkel, DE; Kelley, CT, Convergence analysis of sampling methods for perturbed Lipschitz functions, Pac. J. Optim., 5, 2, 339-350 (2009) · Zbl 1181.65084
[14] Gilmore, P.; Kelley, CT, An implicit filtering algorithm for optimization of functions with many local minima, SIAM J. Optim., 5, 2, 269-285 (1995) · Zbl 0828.65064 · doi:10.1137/0805015
[15] Gonçalves, D.F.: Derivative-free methods for nonlinear programming: linearly constrained problems with noise objective function. Ph.D. thesis, Institute of Mathematics, University of Campinas, Campinas (SP), Brazil (2017) (in Portughese)
[16] Gratton, S., Royer, C.W., Vicente, L.N., Zhang, Z.: Direct search based on probabilistic feasible descent for bound and linearly constrained problems. preprint 17-10, Department of Mathematics, University of Coimbra (2017) · Zbl 1420.90083
[17] Hock, W., Schittkowski, K.: Test examples for nonlinear programming codes. In: Lecture Notes in Economics and Mathematical Systems, vol. 187. Springer (1981) · Zbl 0452.90038
[18] Kelley, CT, Iterative Methods for Optimization (1999), Philadelphia: SIAM, Philadelphia · Zbl 0934.90082
[19] Kelley, CT, Implicit Filtering (2011), Philadelphia: SIAM, Philadelphia · Zbl 1246.68017
[20] Kolda, TG; Lewis, RM; Torczon, V., Optimization by direct search: new perspectives on some classical and modern methods, SIAM Rev., 45, 3, 385-482 (2003) · Zbl 1059.90146 · doi:10.1137/S003614450242889
[21] Lewis, RM; Shepherd, A.; Torczon, V., Implementing generating set search methods for linearly constrained minimization, SIAM J. Sci. Comput., 29, 6, 2507-2530 (2007) · Zbl 1166.90368 · doi:10.1137/050635432
[22] Lewis, RM; Torczon, V., Pattern search methods for linearly constrained minimization, SIAM J. Optim., 10, 3, 917-941 (2000) · Zbl 1031.90048 · doi:10.1137/S1052623497331373
[23] Lucidi, S.; Sciandrone, M.; Tseng, P., Objective-derivative-free methods for constrained optimization, Math. Program., 92, 1, 37-59 (2002) · Zbl 1024.90062 · doi:10.1007/s101070100266
[24] Moler, CB, Numerical Computing with MATLAB (2004), Philadelphia: SIAM, Philadelphia · Zbl 1059.68162
[25] Moré, JJ; Wild, SM, Benchmarking derivative-free optimization algorithms, SIAM J. Optim., 20, 1, 172-191 (2009) · Zbl 1187.90319 · doi:10.1137/080724083
[26] Rill, G., Road Vehicle Dynamics: Fundamentals and Modeling (2011), Boca Raton: CRC Press, Boca Raton
[27] Shampine, LF; Reichelt, MW, The MATLAB ODE suite, SIAM J. Sci. Comput., 18, 1, 1-22 (1997) · Zbl 0868.65040 · doi:10.1137/S1064827594276424
[28] Stoneking, DE; Bilbro, GL; Gilmore, PA; Trew, RJ; Kelley, CT, Yield optimization using a gaas process simulator coupled to a physical device model, IEEE Trans. Microw. Theory Tech., 40, 7, 201-213 (1992) · doi:10.1109/22.146318
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.