zbMATH — the first resource for mathematics

A hybrid conjugate gradient method with descent property for unconstrained optimization. (English) Zbl 1432.90145
Summary: In this paper, based on some famous previous conjugate gradient methods, a new hybrid conjugate gradient method was presented for unconstrained optimization. The proposed method can generate decent directions at every iteration, moreover, this property is independent of the steplength line search. Under the Wolfe line search, the proposed method possesses global convergence. Medium-scale numerical experiments and their performance profiles are reported, which show that the proposed method is promising.

90C30 Nonlinear programming
65K05 Numerical mathematical programming methods
90C52 Methods of reduced gradient type
CUTEr; minpack; CUTE
PDF BibTeX Cite
Full Text: DOI
[1] Fletcher, R.; Reeves, C. M., Function minimization by conjugate gradients, Comput. J., 7, 149-154 (1964) · Zbl 0132.11701
[2] Polak, E.; Ribière, G., Note sur la convergence de mèthodes de directions conjugèes, Rev. Fr. Inform. Rech. Oper., 3, 35-43 (1969) · Zbl 0174.48001
[3] Polyak, B. T., The conjugate gradient method in extreme problems, USSR Comput. Math. Math. Phys., 9, 94-112 (1969) · Zbl 0229.49023
[4] Hestenes, M. R.; Stiefel, E., Method of conjugate gradient for solving linear equations, J. Res. Natl. Bur. Stand., 49, 409-436 (1952) · Zbl 0048.09901
[5] Dai, Y. H.; Yuan, Y. X., A nonlinear conjugate gradient method with a strong global convergence property, SIAM J. Optim., 10, 177-182 (1999) · Zbl 0957.65061
[6] Al-Baali, M., Descent property and global convergence of the Fletcher-Reeves method with inexact line search, IMA J. Numer. Anal., 5, 121-124 (1985) · Zbl 0578.65063
[7] Dai, Y. H.; Yuan, Y. X., Nonlinear Conjugate Gradient Methods (2000), Shanghai Scientific and Technical Publishers: Shanghai Scientific and Technical Publishers Shanghai
[8] Dai, Y. H.; Liao, L. Z., New conjugacy conditions and related nonlinear conjugate gradient methods, Appl. Math. Optim., 43, 87-101 (2001) · Zbl 0973.65050
[9] Hager, W. W.; Zhang, H., A new conjugate gradient method with guaranteed descent and an efficient line search, SIAM J. Optim., 16, 170-192 (2005) · Zbl 1093.90085
[10] Wei, Z. X.; Yao, S. W.; Liu, L. Y., The convergence properties of some new conjugate gradient methods, Appl. Math. Comput., 183, 1341-1350 (2006) · Zbl 1116.65073
[11] Huang, H.; Wei, Z. X.; Yao, S. W., The proof of the sufficient descent condition of the Wei-Yao-Liu conjugate gradient method under the strong Wolfe-Powell line search, Appl. Math. Comput., 189, 1241-1245 (2007) · Zbl 1131.65049
[12] Yao, S. W.; Wei, Z. X.; Huang, H., A note about WYL’s conjugate gradient method and its application, Appl. Math. Comput., 191, 381-388 (2007) · Zbl 1193.90213
[13] Li, G. Y.; Tang, C. M.; Wei, Z. X., New conjugacy condition and related new conjugate gradient methods for unconstrained optimization, J. Comput. Appl. Math., 202, 523-539 (2007) · Zbl 1116.65069
[14] Wei, Z. X.; Li, G. Y.; Qi, L. Q., Global convergence of the Polak-Ribière-Polyak conjugate gradient method with inexact line searches for nonconvex unconstrained optimization problems, Math. Comput., 77, 2173-2193 (2008) · Zbl 1198.65091
[15] Yu, G. H.; Guan, L. T.; Li, G. Y., Global convergence of modified Polak-Ribière-Polyak conjugate gradient methods with sufficient descent property, J. Ind. Manag. Optim., 4, 565-579 (2008) · Zbl 1168.65030
[16] Yuan, G. L.; Lu, X. W., A modified PRP conjugate gradient method, Ann. Oper. Res., 166, 73-90 (2009) · Zbl 1163.90798
[17] Jiang, X. Z.; Ma, G. D.; Jian, J. B., A new global convergent conjugate gradient method with Wolfe line search, Chin. J. Eng. Math., 28, 779-786 (2011) · Zbl 1265.90277
[18] Dai, Y. H.; Kou, C. X., A nonlinear conjugate gradient algorithm with an optimal property and an improved Wolfe line search, SIAM J. Optim., 23, 296-320 (2013) · Zbl 1266.49065
[19] Jiang, X. Z.; Jian, J. B., A sufficient descent Dai-Yuan type nonlinear conjugate gradient method for unconstrained optimization problems, Nonlinear Dyn., 72, 101-112 (2013) · Zbl 1268.65066
[20] Touati-Ahmed, D.; Storey, C., Efficient hybrid conjugate gradient techniques, J. Optim. Theory Appl., 64, 379-397 (1990) · Zbl 0666.90063
[21] Hu, Y. F.; Storey, C., Global convergence result for conjugate gradient methods, J. Optim. Theory Appl., 71, 399-405 (1991) · Zbl 0794.90063
[22] Dai, Y. H.; Yuan, Y. X., An efficient hybrid conjugate gradient method for unconstrained optimization, Ann. Oper. Res., 103, 33-47 (2001) · Zbl 1007.90065
[23] Dai, Y. H., A nonmonotone conjugate gradient algorithm for unconstrained optimization, J. Syst. Sci. Complex., 15, 139-145 (2002) · Zbl 1019.90039
[24] Hager, W. W.; Zhang, H., A survey of nonlinear conjugate gradient methods, Pac. J. Optim., 2, 35-58 (2006) · Zbl 1117.90048
[25] Andrei, N., Hybrid conjugate gradient algorithm for unconstrained optimization, J. Optim. Theory Appl., 141, 249-264 (2009) · Zbl 1168.90017
[26] Jiang, X. Z.; Han, L.; Jian, J. B., A globally convergent mixed conjugate gradient method with Wolfe line search, Math. Numer. Sin., 34, 103-112 (2012) · Zbl 1265.65114
[28] Bongartz, K. E.; Conn, A. R.; Gould, N. I.M.; Toint, P. L., CUTE: constrained and unconstrained testing environments, ACM Trans. Math. Softw., 21, 123-160 (1995) · Zbl 0886.65058
[29] Morè, J.; Garbow, B. S.; Hillstrome, K. E., Testing unconstrained optimization software, ACM Trans. Math. Softw., 7, 17-41 (1981) · Zbl 0454.65049
[30] Dolan, E. D.; Morè, J., Benchmarking optimization software with performance profiles, Math. Prog., 91, 201-213 (2002) · Zbl 1049.90004
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.