×

Particle swarm optimization for determining fuzzy measures from data. (English) Zbl 1242.68296

Summary: Fuzzy measures and fuzzy integrals have been successfully used in many real applications. How to determine fuzzy measures is the most difficult problem in these applications. Though there have existed some methodologies for solving this problem, such as genetic algorithms, gradient descent algorithms and neural networks, it is hard to say which one is more appropriate and more feasible. Each method has its advantages and limitations. Therefore it is necessary to develop new methods or techniques to learn distinct fuzzy measures. In this paper, we make the first attempt to design a special particle swarm algorithm to determine a type of general fuzzy measures from data, and demonstrate that the algorithm is effective and efficient. Furthermore we extend this algorithm to identify and revise other types of fuzzy measures. To test our algorithms, we compare them with the basic particle swarm algorithms, gradient descent algorithms and genetic algorithms in literatures. In addition, for verifying whether our algorithms are robust in noisy-situations, a number of numerical experiments are conducted. Theoretical analysis and experimental results show that, for determining fuzzy measures, the particle swarm optimization is feasible and has a better performance than the existing genetic algorithms and gradient descent algorithms.

MSC:

68T20 Problem solving in the context of artificial intelligence (heuristics, search strategies, etc.)
28E10 Fuzzy measure theory
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Alavi, S. H.; Jassbi, J.; Serra, P. J.A.; Ribeiro, R. A., Defining fuzzy measures: a comparative study with genetic and gradient descent algorithms, (Intelligent Systems at the Service of Mankind, vol. 3 (2009), Springer)
[2] G. Beliakov, Fitting fuzzy measures by linear programming. Programming library fmtools, in: Proceedings of IEEE International Conference on Fuzzy Systems, 2008, pp. 862-867.; G. Beliakov, Fitting fuzzy measures by linear programming. Programming library fmtools, in: Proceedings of IEEE International Conference on Fuzzy Systems, 2008, pp. 862-867.
[3] Biggio, B.; Fumera, G.; Roli, F., Multiple classifier systems for robust classifier design in adversarial environments, International Journal of Machine Learning and Cybernetics, 1, 1-4, 27-41 (2010)
[4] J. Bock, J. Hettenhausen, Discrete particle swarm optimisation for ontology alignment, Information Sciences, in press. doi:10.1016/j.ins.2010.08.013; J. Bock, J. Hettenhausen, Discrete particle swarm optimisation for ontology alignment, Information Sciences, in press. doi:10.1016/j.ins.2010.08.013
[5] Büyüközkan, G.; Ruan, D., Choquet integral based aggregation approach to software development risk, Information Sciences, 180, 3, 441-451 (2010)
[6] Chatterjee, A.; Siarry, P., Nonlinear inertia weight variation for dynamic adaptation in particle swarm optimization, Computer & Operations Research, 33, 859-871 (2006) · Zbl 1114.90159
[7] M. Chen, Y. Liu, Q. Luo, A novel hybrid algorithm with marriage of particle swarm optimization and extremal optimization, Optimization Community e-print, 2007.; M. Chen, Y. Liu, Q. Luo, A novel hybrid algorithm with marriage of particle swarm optimization and extremal optimization, Optimization Community e-print, 2007.
[8] T. Chen, Static and dynamic analyzes of importance assessing for evaluation criteria and applications on transportation, Ph.D. dissertation, Inst. Traffic and Transportation, National Chiao Tung University, Hsinchu, Taiwan, R.O.C, 1998.; T. Chen, Static and dynamic analyzes of importance assessing for evaluation criteria and applications on transportation, Ph.D. dissertation, Inst. Traffic and Transportation, National Chiao Tung University, Hsinchu, Taiwan, R.O.C, 1998.
[9] Chen, T.; Wang, J. C., Identification of \(λ\)-fuzzy measure using sampling design and genetic algorithms, Fuzzy Sets and Systems, 123, 321-334 (2001)
[10] Chen, T.; Wang, J. C.; Tzeng, G. H., Identification of general fuzzy measures by genetic algorithms based on partial information, IEEE Transactions on Systems, Man, And Cybernetics, 30, 4, 517-528 (2000)
[11] Cho, S. B.; Kim, J. H., Combining multiple neural networks by fuzzy integral for robust classification, IEEE Transaction on Systems, Man, and Cybernetics, 25, 2, 380-384 (1995)
[12] Combarro, E. F.; Miranda, P., Identification of fuzzy measures from sample data with genetic algorithms, Computer & Operations Research, 33, 3046-3066 (2006) · Zbl 1086.90069
[13] Daniel, S. Y.; Wang, X. Z.; Tsang, E. C.C., Handling interaction in fuzzy production rule reasoning, IEEE Transaction on Systems, Man, and Cybernetics - Part B: Cybernetics, 34, 5, 1979-1987 (2004)
[14] Dong, Y.; Tang, J.; Xu, Baodong; Wang, Dingwei, An application of particle swarm optimization to nonlinear programming, Computers and Mathematics with Application, 49, 1655-1668 (2005) · Zbl 1127.90407
[15] Friedman, M.; Ma, M.; Kandel, A., On typical values and fuzzy integrals, IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, 27, 4, 703-705 (1997)
[16] M. Grabisch, A new algorithm for identifying fuzzy measures and its application to pattern recognition, in: Processings of FUZZ-IEEE/IFES’95, 1, Yokohama, Japan, 1995, pp. 145-150.; M. Grabisch, A new algorithm for identifying fuzzy measures and its application to pattern recognition, in: Processings of FUZZ-IEEE/IFES’95, 1, Yokohama, Japan, 1995, pp. 145-150.
[17] Grabisch, M.; Nicolas, Nicolas J., Classification by fuzzy integral: performance and tests, Fuzzy Sets and Systems, 65, 2-3, 255-271 (1994)
[18] Grabisch, M., The application of fuzzy integrals in multicriteria decision making, European Journal of Operational Research, 89, 445-456 (1996) · Zbl 0916.90164
[19] Hu, Q. H.; Pan, W.; An, S.; Ma, P. J.; Wei, J. M., An efficient gene selection technique for cancer recognition based on neighborhood mutual information, International Journal of Machine Learning and Cybernetics, 1, 1-4, 63-74 (2010)
[20] X. Hu, R. Eberhart, Solving constrained nonlinear optimization problem with particle swarm optimization, in: Proceedings of the Sixth World Multi-conference on Systemic, Cybernetics and Informatics, 2002.; X. Hu, R. Eberhart, Solving constrained nonlinear optimization problem with particle swarm optimization, in: Proceedings of the Sixth World Multi-conference on Systemic, Cybernetics and Informatics, 2002.
[21] Ishii, K.; Sugeno, M., A model of human evaluation process using fuzzy measure, International Journal of Man-Machine Studies, 22, 19-38 (1985) · Zbl 0567.90059
[22] Juang, C. F., A hybrid of genetic algorithm and particle swarm optimization for recurrent network design, IEEE Transactions on Systems Man and Cybernetics - Part B: Cybernetics, 34, 2, 997-1006 (2004)
[23] Keller, J. M.; Osborn, J., Training the fuzzy integral, International Journal of Approximate Reasoning, 15, 1-24 (1996) · Zbl 0949.68565
[24] J.M. Keller, H. Qiu, H. Tahani, Fuzzy integral and image segmentation, in: Proceedings of NAFIPS’86, New Orleans, 1986, pp. 324-338.; J.M. Keller, H. Qiu, H. Tahani, Fuzzy integral and image segmentation, in: Proceedings of NAFIPS’86, New Orleans, 1986, pp. 324-338.
[25] J. Kennedy, R.C. Eberhart, Particle swarm optimization, in: Proceedings of the IEEE International Conference on Neural Networks, 1995, pp. 1942-1948.; J. Kennedy, R.C. Eberhart, Particle swarm optimization, in: Proceedings of the IEEE International Conference on Neural Networks, 1995, pp. 1942-1948.
[26] Krohling, R. A.; Dos, S. C.L., Coevolutionary particle swarm optimization using Gaussian distribution for solving constrained optimization problems, IEEE Transaction on Systems, Man, and Cybernetics - Part B: Cybernetics, 36, 6, 1407-1416 (2006)
[27] K.M. Lee, H. Leekwang, Genetic algorithms for fuzzy measure identification, in: Proceedings of the 3rd Internet Conference on Fuzzy Logic, Neural Nets and Soft Computing (IIZUKA’94), 1994, pp. 461-463.; K.M. Lee, H. Leekwang, Genetic algorithms for fuzzy measure identification, in: Proceedings of the 3rd Internet Conference on Fuzzy Logic, Neural Nets and Soft Computing (IIZUKA’94), 1994, pp. 461-463.
[28] Lee, K. M.; Leekwang, H., Identification of \(λ\)-fuzzy measure by genetic algorithms, Fuzzy Sets and Systems, 75, 301-309 (1995) · Zbl 0867.68093
[29] Leong, W.; Yen, G. G., PSO-based multiobjective optimization with dynamic population size and adaptive local archives, IEEE Transaction on Systems, Man, and Cybernetics - Part B: Cybernetics, 38, 6, 1270-1293 (2008)
[30] Leung, K. S.; Wong, M. L.; Lam, W.; Wang, Z. Y.; Xu, K., Learning nonlinear multiregression networks based on evolutionary computation, IEEE Transaction on Systems, Man, and Cybernetics - Part B: Cybernetics, 32, 5, 630-644 (2002)
[31] H. Liu, Y. Jheng, W. Lin, G. Chen, A novel fuzzy measure and its Choquet integral regression model, in: Proceedings of the Sixth International Conference on Machine Learning and Cybernetics, Hong Kong, 2007, pp. 1394-1398.; H. Liu, Y. Jheng, W. Lin, G. Chen, A novel fuzzy measure and its Choquet integral regression model, in: Proceedings of the Sixth International Conference on Machine Learning and Cybernetics, Hong Kong, 2007, pp. 1394-1398.
[32] Liu, Z. Q.; Bruton, L. T.; Bezdek, J. C.; Keller, J. M.; Dance, S.; Bartley, N. R.; Zhang, C., Dynamic image sequence analysis using fuzzy measures, IEEE Transaction on Systems, Man, and Cybernetics - Part B: Cybernetics, 31, 4, 557-572 (2001)
[33] Magdi, A. M.; Xiao, W., Q-measures: an efficient extension of the Sugeno-measure, IEEE Transactions on Fuzzy Systems, 11, 419-426 (2003)
[34] A. Mendez-Vazquez, P. Gader, Maximum A Posteriori EM MCE Logistic LASSO for learning fuzzy measures, in: Proceedings of IEEE International Conference on Fuzzy Systems, 2008, pp. 2007-2013.; A. Mendez-Vazquez, P. Gader, Maximum A Posteriori EM MCE Logistic LASSO for learning fuzzy measures, in: Proceedings of IEEE International Conference on Fuzzy Systems, 2008, pp. 2007-2013.
[35] Mendoza, O.; Melin, P.; Licea, G., A hybrid approach for image recognition combining type-2 fuzzy logic, modular neural networks and the Sugeno integral, Information Sciences, 179, 13, 2078-2101 (2009)
[36] P. Miranda, M. Grabisch, P-symmetric fuzzy measures, in: Proceedings of the ninth International Conference of Information Processing and Management of Uncertainty in Knowledge-Based Systems, Annecy, France, 2002, pp. 545-552.; P. Miranda, M. Grabisch, P-symmetric fuzzy measures, in: Proceedings of the ninth International Conference of Information Processing and Management of Uncertainty in Knowledge-Based Systems, Annecy, France, 2002, pp. 545-552. · Zbl 1068.28013
[37] T. Mori, T. Murofushi, An analysis of evaluation model using fuzzy measure and the Choquet integral, in: Proceedings of the 5th Fuzzy Systems Symposium, Kobe, Japan, June 2-3 1989 (in japanese).; T. Mori, T. Murofushi, An analysis of evaluation model using fuzzy measure and the Choquet integral, in: Proceedings of the 5th Fuzzy Systems Symposium, Kobe, Japan, June 2-3 1989 (in japanese).
[38] Y. Shi, R.C. Eberhart, Fuzzy adaptive particle swarm optimization, in: Proceedings of Congress on Evolutionary Computation Seoul, Korea, Piscataway, NJ, IEEE Service Center, 2001, pp. 101-106.; Y. Shi, R.C. Eberhart, Fuzzy adaptive particle swarm optimization, in: Proceedings of Congress on Evolutionary Computation Seoul, Korea, Piscataway, NJ, IEEE Service Center, 2001, pp. 101-106.
[39] Shi, Y.; Eberhart, R. C., Parameter selection in particle swarm optimization, Lecture Notes in Computer Science, 1447, 591-600 (1998)
[40] Shi, Y.; Liu, H. C.; Gao, L.; Zhang, G. H., Cellular particle swarm optimization, Information Sciences, 181, 20, 4457-4490 (2011)
[41] Y.Shi, R.C. Eberhart, A modified particle swarm optimizer, in: Proceedings of the 1998 IEEE International Conference on Evolutionary Computation, 1998, pp. 69-73.; Y.Shi, R.C. Eberhart, A modified particle swarm optimizer, in: Proceedings of the 1998 IEEE International Conference on Evolutionary Computation, 1998, pp. 69-73.
[42] Sundar, S.; Singh, A., A swarm intelligence approach to the quadratic minimum spanning tree problem, Information Sciences, 180, 17, 3182-3191 (2010)
[43] Tahani, H.; Keller, J. M., Information fusion in computer vision using the fuzzy integral, IEEE Transaction on Systems, Man, and Cybernetics, 20, 3, 733-741 (1990)
[44] Tong, D. L.; Mintram, R., Genetic algorithm-neural network (GANN): a study of neural network activation functions and depth of genetic algorithm search applied to feature selection, International Journal of Machine Learning and Cybernetics, 1, 1-4, 75-87 (2010)
[45] Torra, V.; Narukawa, Y., Modeling Decisions: Information Fusion and Aggregation Operators (Cognitive Technologies) (2007), Springer
[46] J. Wang, Z.Y. Wang, Detecting constructions of nonlinear integral systems from input-output data: an application of neural networks, In: Proceedings of the NAFIPS’96., Berkeley, 1996, pp. 559-563.; J. Wang, Z.Y. Wang, Detecting constructions of nonlinear integral systems from input-output data: an application of neural networks, In: Proceedings of the NAFIPS’96., Berkeley, 1996, pp. 559-563.
[47] Wang, J.; Wang, Z. Y., Using neural networks to determine Sugeno measures by statistics, Neural Networks, 10, 1, 183-195 (1997)
[48] J.C. Wang, T.Y. Chen, Bisection algorithms for solving Λ;; J.C. Wang, T.Y. Chen, Bisection algorithms for solving Λ;
[49] Wang, L. J., An improved multiple fuzzy NNC system based on mutual information and fuzzy integral, International Journal of Machine Learning and Cybernetics, 1, 2, 25-36 (2011)
[50] S.M. Wang, J. Watada, A hybrid modified PSO approach to VaR-based facility location problems with variable capacity in fuzzy random uncertainty, Information Sciences, in press. doi:10.1016/j.ins.2010.02.014; S.M. Wang, J. Watada, A hybrid modified PSO approach to VaR-based facility location problems with variable capacity in fuzzy random uncertainty, Information Sciences, in press. doi:10.1016/j.ins.2010.02.014 · Zbl 1248.90060
[51] Wang, W.; Wang, Z. Y.; Klir, G. J., Genetic algorithms for determining fuzzy measures from data, Journal of Intelligent and Fuzzy Systems, 6, 2, 171-183 (1998)
[52] Wang, X. Z.; Lu, S. X.; Zhai, J. H., Fast fuzzy multi-category SVM based on support vector domain description, International Journal of Pattern Recognition and Artificial Intelligences, 22, 1, 109-120 (2008)
[53] Wang, X. Z.; Zhai, J. H.; Lu, S. X., Induction of multiple fuzzy decision trees based on rough set technique, Information Sciences, 178, 16, 3188-3202 (2008) · Zbl 1154.68529
[54] Wang, X. Z.; Zhang, S. F.; Zhai, J. H., A nonlinear integral defined on partition and its application to decision trees, Soft Computing, 11, 4, 317-321 (2007) · Zbl 1121.28022
[55] Wang, Z. Y.; Klir, G. J., Fuzzy measure theory (1992), Plenum Press (A division of Plenum Publishing Corporation): Plenum Press (A division of Plenum Publishing Corporation) New York
[56] Wang, Z. Y.; Leung, K. S.; Wang, J., Determining nonnegative monotone set functions based on Sugeno’s integral: an application of genetic algorithms, Fuzzy Sets and Systems, 112, 155-164 (2000)
[57] Z.Y. Wang, K.S. Leung, J. Wang, Genetic algorithms used for determining belief measures and plausibility measures, in: Proceedings of NAFIPS’97, Syracuse, 1997, pp. 195-198.; Z.Y. Wang, K.S. Leung, J. Wang, Genetic algorithms used for determining belief measures and plausibility measures, in: Proceedings of NAFIPS’97, Syracuse, 1997, pp. 195-198.
[58] Z.Y. Wang, K.S. Leung, J. Wang, Genetic algorithms used for determining non-additive set functions in information fusion, in: Proceedings of IFSA’97, 1999, pp. 518-521.; Z.Y. Wang, K.S. Leung, J. Wang, Genetic algorithms used for determining non-additive set functions in information fusion, in: Proceedings of IFSA’97, 1999, pp. 518-521.
[59] Wang, Z. Y.; Leung, K. S.; Wong, M. L.; Fang, J., A new type of nonlinear integrals and computational algorithm, Fuzzy Sets and Systems, 112, 223-231 (2000) · Zbl 1040.28500
[60] Wang, Z. Y.; Leung, K. S.; Wong, M. L.; Fang, J.; Xu, K., Nonlinear nonnegative multiregressions based on Choquet integrals, International Journal of Approximate Reasoning, 25, 71-87 (2000) · Zbl 0968.68154
[61] Z.Y. Wang, J. Wang, Using genetic algorithm for extension and fitting of belief measures and plausibility measures, in: Proceedings of NAFIPS’96, Berkeley, 1996, pp. 348-350.; Z.Y. Wang, J. Wang, Using genetic algorithm for extension and fitting of belief measures and plausibility measures, in: Proceedings of NAFIPS’96, Berkeley, 1996, pp. 348-350.
[62] Z.Y. Wang, J. Wang, Using genetic algorithms for Λ;; Z.Y. Wang, J. Wang, Using genetic algorithms for Λ;
[63] Wang, Z. Y.; Xu, K.; Wang, J.; Klir, G. J., Using genetic algorithms to determine nonnegative monotone set functions for information fusion in environments with random perturbation, International Journal of Intelligence Systems, 14, 949-962 (1999) · Zbl 0937.68100
[64] Wang, Z. Y.; Xu, K.; Heng, P. A.; Leung, K. S., Indeterminate integrals with respect to nonadditive measures, Fuzzy Sets and Systems, 138, 485-495 (2003) · Zbl 1075.28009
[65] Xu, K.; Wang, Z. Y.; Heng, P. A.; Leung, K. S., Classification by nonlinear integral projections, IEEE Transactions on Fuzzy Systems, 11, 2, 187-201 (2003)
[66] Xu, Z., Choquet integrals of weighted intuitionistic fuzzy information, Information Sciences, 180, 5, 726-736 (2010) · Zbl 1186.68469
[67] Yager, R., On ordered weighted averaging aggregation operators in multicriteria decision making, IEEE Transactions on Systems, Man, and Cybernetics, 18, 183-190 (1988) · Zbl 0637.90057
[68] Yager, R., Uncertainty representation using fuzzy measures, IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, 32, 1, 13-20 (2002)
[69] Yang, R.; Wang, Z. Y.; Heng, P. A.; Leung, K. S., Classification of heterogeneous fuzzy data by Choquet integral with fuzzy-valued integrand, IEEE Transactions on Fuzzy Systems, 15, 5, 931-942 (2007)
[70] Yao, O. Y.; Mesiar, R.; Agahi, H., An inequality related to Minkowski type for Sugeno integrals, Information Sciences, 180, 14, 2793-2801 (2010) · Zbl 1193.28016
[71] Zhang, L.; Yu, H.; Chen, D.; Hu, S., Analysis and improvement of particle swarm optimization algorithm, Information and Control, 33, 5, 513-517 (2004), (in Chinese)
[72] Zhao, H. Y.; Wang, X. Z.; Wei, K., Using a particle swarm algorithm to determine fuzzy measure from data, Fuzzy Systems and Mathematics, 22, A, 357-362 (2008), (in Chinese)
[73] J. Zhu, X.P. Li, W.M. Shen, Effective genetic algorithm for resource-constrained project scheduling with limited preemptions, International Journal of Machine Learning and Cybernetics, in press. doi:10.1007/s13042-011-0014-3; J. Zhu, X.P. Li, W.M. Shen, Effective genetic algorithm for resource-constrained project scheduling with limited preemptions, International Journal of Machine Learning and Cybernetics, in press. doi:10.1007/s13042-011-0014-3
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.