×

A study of particle swarm optimization particle trajectories. (English) Zbl 1093.68105

Summary: Particle Swarm Optimization (PSO) has shown to be an efficient, robust and simple optimization algorithm. Most of the PSO studies are empirical, with only a few theoretical analyses that concentrate on understanding particle trajectories. These theoretical studies concentrate mainly on simplified PSO systems. This paper overviews current theoretical studies, and extend these studies to investigate particle trajectories for general swarms to include the influence of the inertia term. The paper also provides a formal proof that each particle converges to a stable point. An empirical analysis of multi-dimensional stochastic particles is also presented. Experimental results are provided to support the conclusions drawn from the theoretical findings.

MSC:

68T20 Problem solving in the context of artificial intelligence (heuristics, search strategies, etc.)
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] T. Beielstein, K.E. Parsopoulos, M.N. Vrahatis, Tuning pso parameters through sensitivity analysis, in: Technical Report, Reihe Computational Intelligence CI 124/02, Department of Computer Science, University of Dortmund, 2002.; T. Beielstein, K.E. Parsopoulos, M.N. Vrahatis, Tuning pso parameters through sensitivity analysis, in: Technical Report, Reihe Computational Intelligence CI 124/02, Department of Computer Science, University of Dortmund, 2002. · Zbl 1060.65603
[2] Burden, R. L.; Faires, J. D., Numerical Analysis (Chapter 5.11), ((1993), PWS Publishing Company: PWS Publishing Company Boston), 314-321
[3] A. Carlisle, G. Dozier, An off-the-self pso, in: Proceedings of the Workshop on Particle Swarm Optimization, Indianapolis, USA, 2001.; A. Carlisle, G. Dozier, An off-the-self pso, in: Proceedings of the Workshop on Particle Swarm Optimization, Indianapolis, USA, 2001.
[4] M. Clerc, The swarm and the queen: Towards a deterministic and adaptive particl e swarm optimization, in: Proceedings of the IEEE Congress on Evolutionary Computation, 1999, pp. 1951-1957.; M. Clerc, The swarm and the queen: Towards a deterministic and adaptive particl e swarm optimization, in: Proceedings of the IEEE Congress on Evolutionary Computation, 1999, pp. 1951-1957.
[5] M. Clerc, Think locally, act locally: The way of life of cheap-pso, an adaptive pso, Available from <http://clerc.maurice.free.fr/pso/; M. Clerc, Think locally, act locally: The way of life of cheap-pso, an adaptive pso, Available from <http://clerc.maurice.free.fr/pso/
[6] Clerc, M.; Kennedy, J., The particle swarm-explosion, stability, and convergence in a multidimensional complex space, IEEE Transactions on Evolutionary Computation, 6, 1, 58-73 (2002)
[7] R.C. Eberhart, J. Kennedy, A new optimizer using particle swarm theory, in: Proceedings of the Sixth International Symposium on Micromachine and Human Science, Nagoya, Japan, 1995, pp. 39-43.; R.C. Eberhart, J. Kennedy, A new optimizer using particle swarm theory, in: Proceedings of the Sixth International Symposium on Micromachine and Human Science, Nagoya, Japan, 1995, pp. 39-43.
[8] Eberhart, R. C.; Shi, Y., Particle swarm optimization: Developments, applications and resources, (Proceedings of the IEEE Congress on Evolutionary Computation (2001), IEEE Press: IEEE Press Seoul, Korea)
[9] Eberhart, R. C.; Simpson, P. K.; Dobbins, R. W., Computational Intelligence PC Tools (1996), Academic Press Professional
[10] R.C. Eberhart, Y. Shi, Comparing inertia weights and constriction factors in particle swarm optimization, in: Proceedings of the IEEE Congress on Evolutionary Computation, San Diego, USA, 2000, pp. 84-88.; R.C. Eberhart, Y. Shi, Comparing inertia weights and constriction factors in particle swarm optimization, in: Proceedings of the IEEE Congress on Evolutionary Computation, San Diego, USA, 2000, pp. 84-88.
[11] Holland, J., Adaption in natural and artificial systems (1975), University of Michigan Press: University of Michigan Press Ann Arbor, MI
[12] J. Kennedy, The particle swarm: Social adaptation of knowledge, in: Proceedings of the IEEE International Conference on Evolutionary Computation, Indianapolis, USA, 1997, pp. 303-308.; J. Kennedy, The particle swarm: Social adaptation of knowledge, in: Proceedings of the IEEE International Conference on Evolutionary Computation, Indianapolis, USA, 1997, pp. 303-308.
[13] J. Kennedy, Small worlds and mega-minds: Effects of neighborhood topology on particle swarm performance, in: Proceedings of the IEEE Congress on Evolutionary Computation, 1999, pp. 1931-1938.; J. Kennedy, Small worlds and mega-minds: Effects of neighborhood topology on particle swarm performance, in: Proceedings of the IEEE Congress on Evolutionary Computation, 1999, pp. 1931-1938.
[14] Kennedy, J.; Eberhart, R. C., Particle swarm optimization, (Proceedings of the IEEE International Joint Conference on Neural Networks (1995), IEEE Press), 1942-1948
[15] Kennedy, J.; Mendes, R., Population structure and particle performance, Proceedings of the IEEE Congress on Evolutionary Computation (2002), IEEE Press: IEEE Press Honolulu, Hawaii
[16] R. Mendes, P. Cortez, M. Rocha, J. Neves, Particle swarms for feedforward neural network training, in: Proceedings of the International Joint Conference on Neural Networks, 2002, pp. 1895-1899.; R. Mendes, P. Cortez, M. Rocha, J. Neves, Particle swarms for feedforward neural network training, in: Proceedings of the International Joint Conference on Neural Networks, 2002, pp. 1895-1899.
[17] S. Naka, T. Genji, T. Yura, Y. Fukuyama, Practical distribution state estimation using hybrid particle swarm optimization, in: IEEE Power Engineering Society Winter Meeting, Columbus, USA, 2001, pp. 815-820.; S. Naka, T. Genji, T. Yura, Y. Fukuyama, Practical distribution state estimation using hybrid particle swarm optimization, in: IEEE Power Engineering Society Winter Meeting, Columbus, USA, 2001, pp. 815-820.
[18] Naka, S.; Genji, T.; Yura, T.; Fukuyama, Y., A hybrid particle swarm optimization for distribution state estimation, IEEE Transactions on Power Systems, 18, 1, 60-68 (2003)
[19] E. Ozcan, C.K. Mohan, Analysis of a simple particle swarm optimization system, in: Intelligent Engineering Systems through Artificial Neural Networks, 1998, pp. 253-258.; E. Ozcan, C.K. Mohan, Analysis of a simple particle swarm optimization system, in: Intelligent Engineering Systems through Artificial Neural Networks, 1998, pp. 253-258.
[20] E. Ozcan, C.K. Mohan, Particle swarm optimization: Surfing the waves, in: Proceedings of the IEEE Congress on Evolutionary Computation, Washington, DC, USA, 1999.; E. Ozcan, C.K. Mohan, Particle swarm optimization: Surfing the waves, in: Proceedings of the IEEE Congress on Evolutionary Computation, Washington, DC, USA, 1999.
[21] Y. Shi, R.C. Eberhart, A modified particle swarm optimizer, in: Proceedings of the IEEE Congress on Evolutionary Computation, Piscataway, USA, 1998, pp. 69-73.; Y. Shi, R.C. Eberhart, A modified particle swarm optimizer, in: Proceedings of the IEEE Congress on Evolutionary Computation, Piscataway, USA, 1998, pp. 69-73.
[22] Y. Shi, R.C. Eberhart, Parameter selection in particle swarm optimization, in: Proceedings of the Seventh Annual Conference on Evolutionary Programming, New York, USA, 1998, pp. 591-600.; Y. Shi, R.C. Eberhart, Parameter selection in particle swarm optimization, in: Proceedings of the Seventh Annual Conference on Evolutionary Programming, New York, USA, 1998, pp. 591-600.
[23] Shi, Y.; Eberhart, R. C., Empirical study of particle swarm optimization, (Proceedings of the IEEE Congress on Evolutionary Computation (1999), IEEE Press), 1945-1950
[24] Shi, Y.; Eberhart, R. C., Fuzzy adaptive particle swarm optimization, Proceedings of the IEEE Congress on Evolutionary Computation (2001), IEEE Press: IEEE Press Seoul, Korea
[25] Suganthan, P. N., Particle swarm optimiser with neighborhood operator, (Proceedings of the IEEE Congress on Evolutionary Computation (1999), IEEE Press: IEEE Press Piscataway, USA), 1958-1962
[26] Trelea, I. C., The particle swarm optimization algorithm: Convergence analysis and parameter selection, Information Processing Letters, 85, 6, 317-325 (2003) · Zbl 1156.90463
[27] F. van den Bergh, An Analysis of Particle Swarm Optimizers, PhD thesis, Department of Computer Science, University of Pretoria, Pretoria, South Africa, 2002.; F. van den Bergh, An Analysis of Particle Swarm Optimizers, PhD thesis, Department of Computer Science, University of Pretoria, Pretoria, South Africa, 2002.
[28] G. Venter, J. Sobieszczanski-Sobieski, Multidisciplinary optimization of a transport aircraft wing using particle swarm optimization, in: Ninth AIAA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Atlanta, USA, 2002.; G. Venter, J. Sobieszczanski-Sobieski, Multidisciplinary optimization of a transport aircraft wing using particle swarm optimization, in: Ninth AIAA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Atlanta, USA, 2002.
[29] K. Yasuda, A. Ide, N. Iwasaki, Adaptive particle swarm optimization, in: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, 2003, pp. 1554-1559.; K. Yasuda, A. Ide, N. Iwasaki, Adaptive particle swarm optimization, in: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, 2003, pp. 1554-1559.
[30] H. Yoshida, Y. Fukuyama, S. Takayama, Y. Nakanishi, A particle swarm optimization for reactive power and voltage control in electric power systems considering voltage security assessment, in: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, 1999, p. 502.; H. Yoshida, Y. Fukuyama, S. Takayama, Y. Nakanishi, A particle swarm optimization for reactive power and voltage control in electric power systems considering voltage security assessment, in: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, 1999, p. 502.
[31] Y. Zheng, L. Ma, L. Zhang, J. Qian, On the convergence analysis and parameter selection in particle swarm optimization, in: Proceedings of the International Conference on Machine Learning and Cybernetics, 2003, pp. 1802-1807.; Y. Zheng, L. Ma, L. Zhang, J. Qian, On the convergence analysis and parameter selection in particle swarm optimization, in: Proceedings of the International Conference on Machine Learning and Cybernetics, 2003, pp. 1802-1807.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.