A derivative-free line search and DFP method for symmetric equations with global and superlinear convergence. (English) Zbl 0927.65067

Authors’ summary: This paper is concerned with the open problem as to whether the Dennis-Fletcher-Powell (DFP) method with inexact line search converges globally to the minimum of a uniformly convex function. We study this problem by way of a Gauss-Newton approach rather than an ordinary Newton approach. We also propose a derivative-free line search that can be implemented conveniently by a backtracking process and has such an attractive property that any iterative method with this line search generates a sequence of iterates that is approximately norm descent. Moreover, if the Jacobian matrices are uniformly nonsingular, then the generated sequence converges. Under appropriate conditions, we establish global and superlinear convergence of the proposed Gauss-Newton based DFP method, which supports the open problem positively.


65H10 Numerical computation of solutions to systems of equations
65K05 Numerical mathematical programming methods
90C25 Convex programming


Full Text: DOI


[1] DOI: 10.1093/imamat/12.3.223 · Zbl 0282.65041 · doi:10.1093/imamat/12.3.223
[2] DOI: 10.1137/0726042 · Zbl 0676.65061 · doi:10.1137/0726042
[3] DOI: 10.1137/0724077 · Zbl 0657.65083 · doi:10.1137/0724077
[4] DOI: 10.1090/S0025-5718-1974-0343581-1 · doi:10.1090/S0025-5718-1974-0343581-1
[5] DOI: 10.1137/1019005 · Zbl 0356.65041 · doi:10.1137/1019005
[6] DOI: 10.1007/BF00934961 · Zbl 0226.49014 · doi:10.1007/BF00934961
[7] Fletcher R., Practical Methods of Optimization (1987) · Zbl 0905.65002
[8] Fletcher R., Algorithms for Continuous Optimization: The State of the Art pp 109– (1994)
[9] DOI: 10.1007/BF01407874 · Zbl 0505.65018 · doi:10.1007/BF01407874
[10] DOI: 10.1017/S0334270000005208 · Zbl 0596.65034 · doi:10.1017/S0334270000005208
[11] DOI: 10.1007/BF01594933 · Zbl 0736.90068 · doi:10.1007/BF01594933
[12] Li D., J. Hunan Univ., Nat. Sci. 20 pp 16– (1993)
[13] Li, D. and Fukushima, M. 1998. ”A globally and superlinearly convergent Gauss-Newton based BFGS method for symmetric equations”. Department of Applied Mathematics and Physics, Kyoto University. Technical Report 98006 · Zbl 0946.65031
[14] DOI: 10.1017/S0962492900002270 · doi:10.1017/S0962492900002270
[15] Ortega J. M., Iterative Solution of Nonlinear Equations in Several Variables (1970) · Zbl 0241.65046
[16] DOI: 10.1093/imamat/7.1.21 · Zbl 0217.52804 · doi:10.1093/imamat/7.1.21
[17] DOI: 10.1007/BF02592063 · Zbl 0626.90076 · doi:10.1007/BF02592063
[18] DOI: 10.1093/imanum/8.4.487 · Zbl 0661.65061 · doi:10.1093/imanum/8.4.487
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.