×

zbMATH — the first resource for mathematics

Nonmonotonic trust region algorithm. (English) Zbl 0797.90088
Summary: A nonmonotonic trust region method for unconstrained optimization problems is presented. Although the method allows the sequence of values of the objective function to be nonmonotonic, convergence properties similar to those for the usual trust region method are proved under certain conditions, including conditions on the approximate solutions to the subproblem. To make the solution satisfy these conditions, an algorithm to solve the subproblem is also established. Finally, some numerical results are reported which show that the non-monotonic trust region method is superior to the usual trust region method according to both the number of gradient evaluations and the number of function evaluations.

MSC:
90C30 Nonlinear programming
90-08 Computational methods for problems pertaining to operations research and mathematical programming
PDF BibTeX XML Cite
Full Text: DOI
References:
[1] Chamberlain, R. M., Powell, M. J. D., Lemarechal, C., andPedersen, H. C.,The Watchdog Technique for Forcing Convergence in Algorithms for Constrained Optimization, Mathematical Programming Study, Vol. 26, pp. 1-17, 1986. · Zbl 0477.90072
[2] Grippo, L., Lampariello, F., andLucidi, S.,A Nonmonotone Line Search Technique for Newton’s Methods, SIAM Journal on Numerical Analysis, Vol. 23, pp. 707-716, 1986. · Zbl 0616.65067
[3] Grippo, L., Lampariello, F., andLucidi, S.,A Truncated Newton Method with Nonmonotone Line Search for Unconstrained Optimization, Journal of Optimization Theory and Applications, Vol. 60, pp. 401-419, 1989. · Zbl 0632.90059
[4] More, J. J.,Recent Development in Algorithms and Software for Trust Region Methods, Mathematical Programming: The State of the Art, Edited by A. Bachem, M. Grotschel, and B. Kortz, Springer-Verlag, Berlin, Germany, pp. 258-287, 1983.
[5] Shultz, G. A., Schnabel, R. B., andByrd, R. H.,A Family of Trust-Region-Based Algorithms for Unconstrained Minimization with Strong Global Convergence Properties, SIAM Journal on Numerical Analysis, Vol. 22, pp. 47-67, 1985. · Zbl 0574.65061
[6] Powell, M. J. D.,Convergence Properties of a Class of Minimization Algorithms, Nonlinear Programming 2, Edited by O. L. Mangasarian, R. R. Meyer, and S. M. Robinson, Academic Press, New York, New York, pp. 1-27, 1975.
[7] Sorensen, D. C.,Newton’s Method with a Model Trust Region Modification, SIAM Journal on Numerical Analysis, Vol. 19, pp. 409-426, 1982. · Zbl 0483.65039
[8] Steihaug, T.,The Conjugate Gradient Method and Trust Regions in Large-Scale Optimization, SIAM Journal on Numerical Analysis, Vol. 20, pp. 626-637, 1983. · Zbl 0518.65042
[9] Dennis, J. E., Jr., andMei, H. H. W.,Two New Unconstrained Optimization Algorithms Which Use Function and Gradient Values, Journal of Optimization Theory and Applications, Vol. 28, pp. 453-482, 1979. · Zbl 0388.65022
[10] Dennis, J. E., Jr., andSchnabel, R. B.,Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Prentice-Hall, Englewood Cliffs, New Jersey, 1983.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.