GEPSO: a new generalized particle swarm optimization algorithm. (English) Zbl 07318174

Sedighizadeh, Davoud; Masehian, Ellips; Sedighizadeh, Mostafa; Akbaripour, Hossein

Math. Comput. Simul. 179, 194-212 (2021).

Summary: Particle Swarm Optimization (PSO) algorithm is a nature-inspired meta-heuristic that has been utilized as a powerful optimization tool in a wide range of applications since its inception in 1995. Due to the flexibility of its parameters and concepts, PSO has appeared in many variants, probably more than any other meta-heuristic algorithm. This paper introduces the Generalized Particle Swarm Optimization (GEPSO) algorithm as a new version of the PSO algorithm for continuous space optimization, which enriches the original PSO by incorporating two new terms into the velocity updating equation. These terms aim to deepen the interrelations of particles and their knowledge sharing, increase variety in the swarm, and provide a better search in unexplored areas of the search space. Moreover, a novel procedure is utilized for dynamic updating of the particles’ inertia weights, which controls the convergence of the swarm towards a solution. Also, since parameters of heuristic and meta-heuristic algorithms have a significant influence on their performance, a comprehensive guideline for parameter tuning of the GEPSO is developed. The computational results of solving numerous well-known benchmark functions by the GEPSO, original PSO, Repulsive PSO (REPSO), PSO with Passive Congregation (PSOPC), Negative PSO (NPSO), Deterministic PSO (DPSO), and Line Search-Based Derivative-Free PSO (LS-DF-PSO) approaches showed that the GEPSO outperformed the compared methods in terms of mean and standard deviation of fitness function values and runtimes.

MSC:

90-XX	Operations research, mathematical programming
90Cxx	Mathematical programming

Keywords:

heuristic algorithms; particle swarm optimization (PSO); parameter tuning; swarm intelligence

Software:

GEPSO

References:

[1]	Akbaripour, H.; Masehian, E., Efficient and robust parameter tuning for heuristic algorithms (2013)
[2]	Alfaro-Ayala, J. A.; Ayala-Ramirez, V.; Gallegos-Munoz, A.; Uribe-Ramirez, A. R., Optimal location of axial impellers in a stirred tank applying evolutionary programing and CFD, Chem. Eng. Res. Des., 100, 203-211 (2015)
[3]	Altinoz, O. T.; Yilmaz, A. E.; Weber, G. W., Application of chaos embedded PSO for PID parameter tuning, Int. J. Comput. Commun. Control, 7, 2, 204-217 (2012)
[4]	Babu, T. S.; Rajasekar, N.; Sangeetha, K., Modified particle swarm optimization technique based maximum power point tracking for uniform and under partial shading condition, Appl. Soft Comput., 34, 613-624 (2015)
[5]	Banks, A.; Vincent, J.; Anyakoha, C., A review of particle swarm optimization. Part I: background and development, Nat. Comput., 6, 4, 467-484 (2007) · Zbl 1125.90065
[6]	Chuanwen, J.; Bompard, E., A hybrid method of chaotic particle swarm optimization and linear interior for reactive power optimisation, Math. Comput. Simulation, 68, 1, 57-65 (2005) · Zbl 1108.90048
[7]	Eberhart, R.; Kennedy, J., A new optimizer using particle swarm theory, (Micro Machine and Human Science, 1995. MHS’95. Proceedings of the Sixth International Symposium on (1995), IEEE), 39-43
[8]	El-Abd, M., Cooperative models of particle swarm optimizers (2008)
[9]	Faradonbeh, R. S.; Monjezi, M.; Armaghani, D. J., Genetic programing and non-linear multiple regression techniques to predict backbreak in blasting operation, Eng. Comput., 32, 1, 123-133 (2016)
[10]	GáLvez, A.; Iglesias, A., A new iterative mutually coupled hybrid GA-PSO approach for curve fitting in manufacturing, Appl. Soft Comput., 13, 3, 1491-1504 (2013)
[11]	Ghamisi, P.; Couceiro, M. S.; Martins, F. M.; Benediktsson, J. A., Multilevel image segmentation based on fractional-order Darwinian particle swarm optimization, IEEE Trans. Geosci. Remote Sens., 52, 5, 2382-2394 (2014)
[12]	Gou, J.; Lei, Y.-X.; Guo, W.-P.; Wang, C.; Cai, Y.-Q.; Luo, W., A novel improved particle swarm optimization algorithm based on individual difference evolution, Appl. Soft Comput., 57, 468-481 (2017)
[13]	He, S.; Wu, Q.; Wen, J.; Saunders, J.; Paton, R., A particle swarm optimizer with passive congregation, Biosystems, 78, 1-3, 135-147 (2004)
[14]	Jain, I.; Jain, V. K.; Jain, R., Correlation feature selection based improved-Binary Particle Swarm Optimization for gene selection and cancer classification, Appl. Soft Comput., 62, 203-215 (2018)
[15]	Jordehi, A. R., Enhanced leader PSO (ELPSO): a new PSO variant for solving global optimisation problems, Appl. Soft Comput., 26, 401-417 (2015)
[16]	Keedwell, E.; Morley, M.; Croft, D., Continuous trait-based particle swarm optimisation (CTB-PSO), (International Conference on Swarm Intelligence (2012), Springer), 342-343
[17]	Kiran, M. S., Particle swarm optimization with a new update mechanism, Appl. Soft Comput., 60, 670-678 (2017)
[18]	Lee, K. H.; Baek, S. W.; Kim, K. W., Inverse radiation analysis using repulsive particle swarm optimization algorithm, Int. J. Heat Mass Transfer, 51, 11-12, 2772-2783 (2008) · Zbl 1144.80373
[19]	Lee, C.-H.; Lee, Y.-C.; Chang, F.-Y., A dynamic fuzzy neural system design via hybridization of EM and PSO algorithms, IAENG Int. J. Comput. Sci., 37, 3, 242-251 (2010)
[20]	Lin, C.; Liu, Y.; Lee, C., An efficient neural fuzzy network based on immune particle swarm optimization for prediction and control applications, Int. J. Innovative Comput. Inf. Control, 4, 7, 1711-1722 (2008)
[21]	Luan, J.; Yao, Z.; Zhao, F.; Song, X., A novel method to solve supplier selection problem: Hybrid algorithm of genetic algorithm and ant colony optimization, Math. Comput. Simulation, 156, 294-309 (2019)
[22]	Mason, K.; Duggan, J.; Howley, E., A meta optimisation analysis of particle swarm optimisation velocity update equations for watershed management learning, Appl. Soft Comput., 62, 148-161 (2018)
[23]	Miranda, V.; Fonseca, N., EPSO-best-of-two-worlds meta-heuristic applied to power system problems, (Evolutionary Computation, 2002. CEC’02. Proceedings of the 2002 Congress on, Vol. 2 (2002), IEEE), 1080-1085
[24]	Naik, B. B.; Raju, C. P.; Rao, R. S., A Constriction Factor based Particle Swarm Optimization for Congestion Management in Transmission Systems, Int. J. Electr. Eng. Inform., 10, 2, 232-241 (2018)
[25]	Neethling, M.; Engelbrecht, A. P., Determining RNA secondary structure using set-based particle swarm optimization, (Evolutionary Computation, 2006. CEC 2006. IEEE Congress on (2006), IEEE), 1670-1677
[26]	Ong, S.-H.; Lee, W.-J.; Low, Y.-C., A general method of computing mixed Poisson probabilities by Monte Carlo sampling, Math. Comput. Simulation, 170, 98-106 (2020)
[27]	Rozenberg, G.; Bäck, T.; Kok, J. N., Handbook of Natural Computing (2012), Springer
[28]	Schoeman, I.; Engelbrecht, A., Using vector operations to identify niches for particle swarm optimization, (Cybernetics and Intelligent Systems, 2004 IEEE Conference on, Vol. 1 (2004), IEEE), 361-366
[29]	Sedighizadeh, M.; Esmaili, M.; Parvaneh, H., Coordinated optimization and control of SFCL and SMES for mitigation of SSR using HBB-BC algorithm in a fuzzy framework, J. Energy Storage, 18, 498-508 (2018)
[30]	Sedighizadeh, D.; Masehian, E., Particle swarm optimization methods, taxonomy and applications, Int. J. Comput. Theory Eng., 1, 5, 486 (2009)
[31]	A. Serani, M. Diez, Are random coefficients needed in particle swarm optimization for simulation-based ship design, in: Proceedings of the 7th International Conference on Computational Methods in Marine Engineering (Marine 2017), 2017.
[32]	Serani, A.; Diez, M.; Campana, E. F.; Fasano, G.; Peri, D.; Iemma, U., Globally convergent hybridization of particle swarm optimization using line search-based derivative-free techniques, (Recent Advances in Swarm Intelligence and Evolutionary Computation (2015), Springer), 25-47
[33]	Serani, A.; Leotardi, C.; Iemma, U.; Campana, E. F.; Fasano, G.; Diez, M., Parameter selection in synchronous and asynchronous deterministic particle swarm optimization for ship hydrodynamics problems, Appl. Soft Comput., 49, 313-334 (2016)
[34]	Shi, Y.; Eberhart, R. C., Fuzzy adaptive particle swarm optimization, (Evolutionary Computation, 2001. Proceedings of the 2001 Congress on, Vol. 1 (2001), IEEE), 101-106
[35]	Taherkhani, M.; Safabakhsh, R., A novel stability-based adaptive inertia weight for particle swarm optimization, Appl. Soft Comput., 38, 281-295 (2016)
[36]	Talbi, E.-G., Metaheuristics: From Design to Implementation (2009), John Wiley & Sons · Zbl 1190.90293
[37]	Tao, Q.; Chang, H.; Yi, Y.; Gu, C.; Yu, Y., QoS constrained grid workflow scheduling optimization based on a novel PSO algorithm, (Grid and Cooperative Computing, 2009. GCC’09. Eighth International Conference on (2009), IEEE), 153-159
[38]	Wolpert, D. H.; Macready, W. G., No free lunch theorems for optimization, IEEE Trans. Evol. Comput., 1, 1, 67-82 (1997)
[39]	Yang, C.; Simon, D., A new particle swarm optimization technique, (Null (2005), IEEE), 164-169
[40]	Yu, C.; Teo, K. L.; Zhang, L.; Bai, Y., A new exact penalty function method for continuous inequality constrained optimization problems, J. Ind. Manag. Optim., 6, 895-910 (2010) · Zbl 1203.90010
[41]	Zhang, Y.; Gong, D.-w.; Geng, N.; Sun, X.-y., Hybrid bare-bones PSO for dynamic economic dispatch with valve-point effects, Appl. Soft Comput., 18, 248-260 (2014)
[42]	Zhang, L.; Tang, Y.; Hua, C.; Guan, X., A new particle swarm optimization algorithm with adaptive inertia weight based on Bayesian techniques, Appl. Soft Comput., 28, 138-149 (2015)
[43]	Zheng, T.; Yamashiro, M., Solving flow shop scheduling problems by quantum differential evolutionary algorithm, Int. J. Adv. Manuf. Technol., 49, 5-8, 643-662 (2010)