×

Differential evolution with adaptive mutation strategy based on fitness landscape analysis. (English) Zbl 1474.68479

Summary: In recent years, many different differential evolution (DE) variants have been proposed to solve real-world optimization problems. However, the performance of them is largely determined by the selection of the mutation strategy, an approach to choose favorable mutation strategy when solving various optimization problems has attracted increasing attention recently. In this paper, we propose a DE with an adaptive mutation operator based on fitness landscape (FLDE). The application of fitness landscape to DE requires three stages. First, we analyzed the fitness landscape features of each benchmark training function, a total of 45 benchmark functions are taken from CEC2014 and 2015. Then, the relationship between three mutation strategies and fitness landscape features is trained by random forest (RF) offline. Finally, the trained RF is used to predict which mutation strategy should be utilized to perform mutation operator for each problem during the evolutionary process. Besides, a historical memory parameter adaption mechanism and population size linear reduction are applied to the FLDE. The CEC2017 benchmark set is utilized to perform the experiments, and five well-known DE variant algorithms are compared with the FLDE algorithm. The experimental results attest that the proposed FLDE algorithm is highly competitive with the other five DE algorithms.

MSC:

68W50 Evolutionary algorithms, genetic algorithms (computational aspects)
90C59 Approximation methods and heuristics in mathematical programming

Software:

JADE; CEC 13
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Bilel, N.; Mohamed, N.; Zouhaier, A., An efficient evolutionary algorithm for engineering design problems, Soft. Comput., 23, 15, 6197-6213 (2019)
[2] Jena, C.; Basu, M.; Panigrahi, C. K., Differential evolution with Gaussian mutation for combined heat and power economic dispatch, Soft. Comput., 20, 2, 681-688 (2016)
[3] Zeng, N.; Zhang, H.; Chen, Y., Path planning for intelligent robot based on switching local evolutionary PSO algorithm, Assembly Automation, 36, 2, 120-126 (2016)
[4] N.H. Awad, M.Z. Ali, J.J. Liang, B.Y. Qu, P.N. Suganthan, “Problem Definitions and Evaluation Criteria for the CEC 2017 Special Session and Competition on Single Objective Bound Constrained Real-Parameter Numerical Optimization”, Technical Report, Nanyang Technological University, Singapore, 2016.
[5] Read J, Martino L, Luengo D. Efficient Monte Carlo optimization for multi-label classifier chains[C]//2013 IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 2013: 3457-3461.
[6] Martino, L.; Elvira, V.; Luengo, D., Orthogonal parallel MCMC methods for sampling and optimization, Digital Signal Process., 58, 64-84 (2016)
[7] Vikhar, P. A., Evolutionary algorithms: A critical review and its future prospects[C]//2016 International conference on global trends in signal processing, information computing and communication (ICGTSPICC), IEEE, 261-265 (2016)
[8] Biedrzycki, R.; Arabas, J.; Jagodziński, D., Bound constraints handling in differential evolution: an experimental study, Swarm Evol. Comput., 50, Article 100453 pp. (2019)
[9] Storn, R.; Price, K., Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces, J. Global Optim., 11, 4, 341-359 (1997) · Zbl 0888.90135
[10] Das, S.; Mullick, S. S.; Suganthan, P. N., Recent advances in differential evolution-an updated survey, Swarm Evol. Comput., 27, 1-30 (2016)
[11] Stanovov, V.; Akhmedova, S.; Semenkin, E., Selective pressure strategy in differential evolution: exploitation improvement in solving global optimization problems, Swarm Evol. Comput., 50, Article 100463 pp. (2019)
[12] Fan, Q.; Yan, X., Self-adaptive differential evolution algorithm with zoning evolution of control parameters and adaptive mutation strategies, IEEE Trans. Cybern., 46, 1, 219-232 (2015)
[13] Mohamed, A. W.; Hadi, A. A.; Jambi, K. M., Novel mutation strategy for enhancing SHADE and LSHADE algorithms for global numerical optimization, Swarm Evol. Comput., 50, Article 100455 pp. (2019)
[14] Liu, J.; Lampinen, J., A fuzzy adaptive differential evolution algorithm, Soft. Comput., 9, 6, 448-462 (2005) · Zbl 1076.93513
[15] Islam, S. M.; Das, S.; Ghosh, S., An adaptive differential evolution algorithm with novel mutation and crossover strategies for global numerical optimization, Syst. Man Cybernetics, 42, 2, 482-500 (2012)
[16] Brest, J.; Greiner, S.; Boskovic, B., Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems, IEEE Trans. Evol. Comput., 10, 6, 646-657 (2006)
[17] Zhang, J.; Sanderson, A. C., JADE: adaptive differential evolution with optional external archive, IEEE Trans. Evol. Comput., 13, 5, 945-958 (2009)
[18] Tanabe R, Fukunaga A. Evaluating the performance of SHADE on CEC 2013 benchmark problems[C]//2013 IEEE Congress on evolutionary computation. IEEE, 2013: 1952-1959.
[19] Tanabe, R.; Fukunaga, A. S., Improving the search performance of SHADE using linear population size reduction[C]//2014 IEEE congress on evolutionary computation (CEC), IEEE, 1658-1665 (2014)
[20] Brest, J.; Maučec, M. S.; Bošković, B., Single objective real-parameter optimization: algorithm jSO[C]//2017 IEEE congress on evolutionary computation (CEC), IEEE, 1311-1318 (2017)
[21] Poláková, R.; Tvrdík, J.; Bujok, P., Evaluating the performance of L-SHADE with competing strategies on CEC2014 single parameter-operator test suite[C]//2016 IEEE Congress on Evolutionary Computation (CEC), IEEE, 1181-1187 (2016)
[22] Awad, N. H.; Ali, M. Z.; Suganthan, P. N., An ensemble sinusoidal parameter adaptation incorporated with L-SHADE for solving CEC2014 benchmark problems[C]//2016 IEEE congress on evolutionary computation (CEC), IEEE, 2958-2965 (2016)
[23] Stanovov V, Akhmedova S, Semenkin E. LSHADE Algorithm with Rank-Based Selective Pressure Strategy for Solving CEC 2017 Benchmark Problems[C]//2018 IEEE Congress on Evolutionary Computation (CEC). IEEE, 2018: 1-8.
[24] Qin, A. K.; Huang, V. L.; Suganthan, P. N., Differential evolution algorithm with strategy adaptation for global numerical optimization, IEEE Trans. Evol. Comput., 13, 2, 398-417 (2008)
[25] Wang, Y.; Cai, Z.; Zhang, Q., Differential evolution with composite trial vector generation strategies and control parameters, IEEE Trans. Evol. Comput., 15, 1, 55-66 (2011)
[26] Elsayed, S. M.; Sarker, R. A.; Essam, D. L., Multi-operator based evolutionary algorithms for solving constrained optimization problems, Comput. Oper. Res., 38, 12, 1877-1896 (2011) · Zbl 1215.90051
[27] Mallipeddi, R.; Suganthan, P. N.; Pan, Q. K., Differential evolution algorithm with ensemble of parameters and mutation strategies, Appl. Soft Comput., 11, 2, 1679-1696 (2011)
[28] Wu, G.; Mallipeddi, R.; Suganthan, P. N., Differential evolution with multi-population based ensemble of mutation strategies, Inf. Sci., 329, 329-345 (2016)
[29] Sharma M, Komninos A, López-Ibáñez M, et al. Deep reinforcement learning based parameter control in differential evolution[C]//Proceedings of the Genetic and Evolutionary Computation Conference. 2019: 709-717.
[30] S. Wright, The roles of mutation, inbreeding, crossbreeding, and selection in evolution, in Proc. 6th Congress on Genetics, 1932: 356-366.
[31] Merz, P., Advanced fitness landscape analysis and the performance of memetic algorithms, Evol. Comput., 12, 3, 303-325 (2004)
[32] Bischl, B.; Mersmann, O.; Trautmann, H., Algorithm selection based on exploratory landscape analysis and cost-sensitive learning[C]//Proceedings of the 14th annual conference on Genetic and evolutionary computation, ACM, 313-320 (2012)
[33] Shen, L.; He, J., A mixed strategy for evolutionary programming based on local fitness landscape[C]//IEEE Congress on Evolutionary Computation, IEEE, 1-8 (2010)
[34] Wang, M.; Li, B.; Zhang, G., Population evolvability: dynamic fitness landscape analysis for population-based metaheuristic algorithms, IEEE Trans. Evol. Comput., 22, 4, 550-563 (2017)
[35] Malan, K. M.; Engelbrecht, A. P., Particle swarm optimisation failure prediction based on fitness landscape characteristics[C]//2014 IEEE Symposium on Swarm Intelligence, IEEE, 1-9 (2014)
[36] Li, K.; Liang, Z.; Yang, S., Performance analyses of differential evolution algorithm based on dynamic fitness landscape, Int. J. Cog. Inform. Natural Intell. (IJCINI), 13, 1, 36-61 (2019)
[37] Li, W.; Li, S.; Chen, Z., Self-feedback differential evolution adapting to fitness landscape characteristics, Soft. Comput., 23, 4, 1151-1163 (2019)
[38] Sallam, K.; Elsayed, S.; Sarker, R., Landscape-Based Differential Evolution for Constrained Optimization Problems[C]//2018 IEEE Congress on Evolutionary Computation (CEC), IEEE, 1-8 (2018)
[39] Sallam, K. M.; Elsayed, S. M.; Sarker, R. A., Landscape-assisted multi-operator differential evolution for solving constrained optimization problems, Expert Syst. Appl., 162, Article 113033 pp. (2020)
[40] Jones, T.; Forrest, S., Fitness distance correlation as a measure of problem difficulty for genetic algorithms, Proc. 6th Internat. Conf. on Genetic Algorithms. (1995)
[41] Malan, K. M.; Engelbrecht, A. P., Quantifying ruggedness of continuous landscapes using entropy[C]//2009 IEEE Congress on evolutionary computation, IEEE, 1440-1447 (2009)
[42] Liang J J, Qu B Y, Suganthan P N. Problem definitions and evaluation criteria for the CEC 2014 special session and competition on single objective real-parameter numerical optimization[J]. Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Nanyang Technological University, Singapore, 2013, 635.
[43] Chen Q, Liu B, Zhang Q, et al. Problem definitions and evaluation criteria for CEC 2015 special session on bound constrained single-objective computationally expensive numerical optimization[J]. Technical Report, Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou, China and Technical Report, Nanyang Technological University, 2014.
[44] Xu, J. L.; Sun, D. W., Identification of freezer burn on frozen salmon surface using hyperspectral imaging and computer vision combined with machine learning algorithm, Int. J. Refrig, 74, 151-164 (2017)
[45] Viktorin, A.; Senkerik, R.; Pluhacek, M., Distance based parameter adaptation for success-history based differential evolution, Swarm Evol. Comput., 50, Article 100462 pp. (2019)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.