zbMATH — the first resource for mathematics

An improved nonmonotone adaptive trust region method. (English) Zbl 07088744
Summary: Trust region methods are a class of effective iterative schemes in numerical optimization. In this paper, a new improved nonmonotone adaptive trust region method for solving unconstrained optimization problems is proposed. We construct an approximate model where the approximation to Hessian matrix is updated by the scaled memoryless BFGS update formula, and incorporate a nonmonotone technique with the new proposed adaptive trust region radius. The new ratio to adjusting the next trust region radius is different from the ratio in the traditional trust region methods. Under some suitable and standard assumptions, it is shown that the proposed algorithm possesses global convergence and superlinear convergence. Numerical results demonstrate that the proposed method is very promising.
90C30 Nonlinear programming
Full Text: DOI
[1] Ahookhosh, M.; Amini, K., A nonmonotone trust region method with adaptive radius for unconstrained optimization problems, Comput. Math. Appl. 60 (2010), 411-422
[2] Ahookhosh, M.; Amini, K., An efficient nonmonotone trust-region method for unconstrained optimization, Numer. Algorithms 59 (2012), 523-540
[3] Andrei, N., An unconstrained optimization test functions collection, Adv. Model. Optim. 10 (2008), 147-161
[4] Andrei, N., Accelerated scaled memoryless BFGS preconditioned conjugate gradient algorithm for unconstrained optimization, Eur. J. Oper. Res. 204 (2010), 410-420
[5] Chamberlain, R. M.; Powell, M. J. D.; Lemarechal, C.; Pedersen, H. C., The watchdog technique for forcing convergence in algorithms for constrained optimization, Math. Program. Study 16 (1982), 1-17
[6] Conn, A. R.; Gould, N. I. M.; Toint, P. L., Trust-Region Methods, MPS/SIAM Series on Optimization, Society for Industrial and Applied Mathematics; Mathematical Programming Society, Philadelphia (2000)
[7] Deng, N. Y.; Xiao, Y.; Zhou, F. J., Nonmonotonic trust region algorithm, J. Optimization Theory Appl. 76 (1993), 259-285
[8] Dolan, E. D.; Moré, J. J., Benchmarking optimization software with performance profiles, Math. Program. 91 (2002), 201-213
[9] Fan, J.-Y.; Yuan, Y.-X., A new trust region algorithm with trust region radius converging to zero, Proceedings of the 5th International Conference on Optimization: Techniques and Applications Hong Kong (2001), 786-794
[10] Gould, N. I. M.; Orban, D.; Toint, P. L., CUTEr and SifDec: a constrained and unconstrained testing environment, revisited, ACM Trans. Math. Softw. 29 (2003), 373-394
[11] Grippo, L.; Lampariello, F.; Lucidi, S., A nonmonotone line search technique for Newton’s method, SIAM J. Numer. Anal. 23 (1986), 707-716
[12] Kamandi, A.; Amini, K.; Ahookhosh, M., An improved adaptive trust-region algorithm, Optim. Lett. 11 (2017), 555-569
[13] Li, D.; Fukushima, M., A modified BFGS method and its global convergence in nonconvex minimization, J. Comput. Appl. Math. 129 (2001), 15-35
[14] Maratos, N., Exact penalty function algorithms for finite dimensional and control optimization problems, Ph.D. Thesis, University of London, London (1978)
[15] Marquardt, D. W., An algorithm for least-squares estimation of nonlinear parameters, J. Soc. Ind. Appl. Math. 11 (1963), 431-441
[16] Peyghami, M. R.; Tarzanagh, D. A., A relaxed nonmonotone adaptive trust region method for solving unconstrained optimization problems, Comput. Optim. Appl. 61 (2015), 321-341
[17] Powell, M. J. D., A new algorithm for unconstrained optimization, Nonlinear Programming, Proceedings of a Symposium Conducted by the Mathematics Research Center Academic Press, New York (1970), 31-65
[18] Rezaee, S.; Babaie-Kafaki, S., An adaptive nonmonotone trust region algorithm, Optim. Methods Softw. 34 (2019), 264-277
[19] Shi, Z.-J.; Guo, J., A new trust region method with adaptive radius, Comput. Optim. Appl. 41 (2008), 225-242
[20] Sun, W., Nonmonotone trust region method for solving optimization problems, Appl. Math. Comput. 156 (2004), 159-174
[21] Sun, W.; Yuan, Y., Optimization Theory and Methods. Nonlinear Programming, Springer Optimization and Its Applications 1, Springer, New York (2006)
[22] Winfield, D., Function minimization by interpolation in a data table, J. Inst. Math. Appl. 12 (1973), 339-347
[23] Zhang, J.-L.; Zhang, X.-S., A nonmonotone adaptive trust region method and its convergence, Comput. Math. Appl. 45 (2003), 1469-1477
[24] Zhang, X.; Zhang, J.; Liao, L., An adaptive trust region method and its convergence, Sci. China, Ser. A 45 (2002), 620-631
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.