Modification of nonlinear conjugate gradient method with weak Wolfe-Powell line search. (English) Zbl 1470.90158

Alhawarat, Ahmad; Salleh, Zabidin

Abstr. Appl. Anal. 2017, Article ID 7238134, 6 p. (2017).

Summary: Conjugate gradient (CG) method is used to find the optimum solution for the large scale unconstrained optimization problems. Based on its simple algorithm, low memory requirement, and the speed of obtaining the solution, this method is widely used in many fields, such as engineering, computer science, and medical science. In this paper, we modified CG method to achieve the global convergence with various line searches. In addition, it passes the sufficient descent condition without any line search. The numerical computations under weak Wolfe-Powell line search shows that the efficiency of the new method is superior to other conventional methods.

MSC:

90C53	Methods of quasi-Newton type
65K05	Numerical mathematical programming methods

Software:

MVF; CUTEr; CUTE

References:

[1]	Dai, Y.-H., Conjugate gradient methods with Armijo-type line searches, Acta Mathematicae Applicatae Sinica, 18, 1, 123-130, (2002) · Zbl 1114.90479
[2]	Hestenes, M. R.; Stiefel, E., Methods of Conjugate Gradients for Solving Linear Systems, 49, (1952), Washington, DC, USA: National Bureau of Standards, Washington, DC, USA · Zbl 0048.09901
[3]	Fletcher, R.; Reeves, C. M., Function minimization by conjugate gradients, The Computer Journal, 7, 2, 149-154, (1964) · Zbl 0132.11701
[4]	Polak, E.; Ribière, G., Note sur la convergence de méthodes de directions conjuguées, Revue Française d’Automatique, Informatique, Recherche Opérationnelle, 3, 16, 35-43, (1969) · Zbl 0174.48001
[5]	Fletcher, R., Practical methods of optimization, (2001), New York, NY, USA: Wiley-Interscience John Wiley & Sons, New York, NY, USA · Zbl 0988.65043
[6]	Liu, Y.; Storey, C., Efficient generalized conjugate gradient algorithms. I. Theory, Journal of Optimization Theory and Applications, 69, 1, 129-137, (1991) · Zbl 0702.90077
[7]	Dai, Y. H.; Yuan, Y., Nonlinear Conjugate Gradient Methods, (2000), Shanghai, China: Shanghai Science and Technology Publisher, Shanghai, China · Zbl 1030.90141
[8]	Wei, Z.; Yao, S.; Liu, L., The convergence properties of some new conjugate gradient methods, Applied Mathematics and Computation, 183, 2, 1341-1350, (2006) · Zbl 1116.65073
[9]	Hager, W. W.; Zhang, H., A new conjugate gradient method with guaranteed descent and an efficient line search, SIAM Journal on Optimization, 16, 1, 170-192, (2005) · Zbl 1093.90085
[10]	Zoutendijk, G., Nonlinear programming, computational methods, Integer and Nonlinear Programming, 37-86, (1970) · Zbl 0336.90057
[11]	Al-Baali, M., Descent property and global convergence of the Fletcher-Reeves method with inexact line search, IMA Journal of Numerical Analysis, 5, 1, 121-124, (1985) · Zbl 0578.65063
[12]	Liu, G. H.; Han, J. Y.; Yin, H. X., Global convergence of the Fletcher-Reeves algorithm with inexact linesearch, Applied Mathematics, 10, 1, 75-82, (1995) · Zbl 0834.90122
[13]	Gilbert, J. C.; Nocedal, J., Global convergence properties of conjugate gradient methods for optimization, SIAM Journal on Optimization, 2, 1, 21-42, (1992) · Zbl 0767.90082
[14]	Alhawarat, A.; Mamat, M.; Rivaie, M.; Mohd, I., A new modification of nonlinear conjugate gradient coefficients with global convergence properties, World Academy of Science, Engineering and Technology, International Science Index 85, International Journal of Mathematical, Computational, Physical and Quantum Engineering, 8, 1, 54-60, (2014)
[15]	Alhawarat, A.; Mamat, M.; Rivaie, M.; Salleh, Z., An efficient hybrid conjugate gradient method with the strong Wolfe-Powell line search, Mathematical Problems in Engineering, 2015, (2015) · Zbl 1394.90556
[16]	Salleh, Z.; Alhawarat, A., An efficient modification of the Hestenes-Stiefel nonlinear conjugate gradient method with restart property, Journal of Inequalities and Applications, 2016, 1, article no. 110, (2016) · Zbl 1337.65048
[17]	Alhawarat, A.; Salleh, Z.; Mamat, M.; Rivaie, M., An efficient modified Polak–Ribière–Polyak conjugate gradient method with global convergence properties, Optimization Methods and Software, 1-14, (2016) · Zbl 1379.49028
[18]	Al-Baali, M.; Narushima, Y.; Yabe, H., A family of three-term conjugate gradient methods with sufficient descent property for unconstrained optimization, Computational Optimization and Applications, 60, 1, 89-110, (2015) · Zbl 1315.90051
[19]	Hager, W. W.; Zhang, H., The limited memory conjugate gradient method, SIAM Journal on Optimization, 23, 4, 2150-2168, (2013) · Zbl 1298.90129
[20]	Shengwei, Y.; Wei, Z.; Huang, H., A note about WYL’s conjugate gradient method and its applications, Applied Mathematics and Computation, 191, 2, 381-388, (2007) · Zbl 1193.90213
[21]	Zhang, L., An improved Wei-Yao-Liu nonlinear conjugate gradient method for optimization computation, Applied Mathematics and Computation, 215, 6, 2269-2274, (2009) · Zbl 1181.65089
[22]	Dai, Z.; Wen, F., Another improved Wei-Yao-Liu nonlinear conjugate gradient method with sufficient descent property, Applied Mathematics and Computation, 218, 14, 7421-7430, (2012) · Zbl 1254.65074
[23]	Huang, H.; Lin, S., A modified Wei–Yao–Liu conjugate gradient method for unconstrained optimization, Applied Mathematics and Computation, 231, 179-186, (2014) · Zbl 1410.90245
[24]	Adorio, E. P.; Diliman, U. P., Mvf-multivariate test functions library in C for unconstrained global optimization
[25]	Bongartz, I.; Conn, A. R.; Gould, N.; Toint, P. L., CUTE: constrained and unconstrained testing environment, ACM Transactions on Mathematical Software, 21, 1, 123-160, (1995) · Zbl 0886.65058
[26]	Andrei, N., An unconstrained optimization test functions collection, Advanced Modeling and Optimization, 10, 1, 147-161, (2008) · Zbl 1161.90486
[27]	Dolan, E. D.; Moré, J. J., Benchmarking optimization software with performance profiles, Mathematical Programming, 91, 2, 201-213, (2002) · Zbl 1049.90004