×

Combining boosting and evolutionary algorithms for learning of fuzzy classification rules. (English) Zbl 1081.68084

Summary: This paper presents a novel boosting algorithm for genetic learning of fuzzy classification rules. The method is based on the iterative rule learning approach to fuzzy rule base system design. The fuzzy rule base is generated in an incremental fashion, in that the evolutionary algorithm optimizes one fuzzy classifier rule at a time. The boosting mechanism reduces the weight of those training instances that are classified correctly by the new rule. Therefore, the next rule generation cycle focuses on fuzzy rules that account for the currently uncovered or misclassified instances. The weight of a fuzzy rule reflects the relative strength the boosting algorithm assigns to the rule class when it aggregates the casted votes. The approach is compared with other classification algorithms for a number problem sets from the UCI repository.

MSC:

68T05 Learning and adaptive systems in artificial intelligence

Software:

UCI-ml
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Bäck, T., Evolutionary Algorithms in Theory and Practice (1996), Oxford University Press: Oxford University Press Oxford · Zbl 0877.68060
[2] C. Blake, C. Merz, UCI repository of machine learning databases (1998). URL; C. Blake, C. Merz, UCI repository of machine learning databases (1998). URL
[3] Bonissone, P. P., Soft computingthe convergence of emerging reasoning technologies, Soft Comput., 1, 1, 6-18 (1997)
[4] Cordón, O.; del Jesus, M. J.; Herrera, F., Genetic learning of fuzzy rule-based classification systems cooperating with fuzzy reasoning methods, Int. J. Intell. Systems, 13, 10-11, 1025-1053 (1998)
[5] Cordón, O.; Herrera, F.; Hoffmann, F.; Magdalena, L., Genetic Fuzzy Systems: Evolutionary Tuning and Learning of Fuzzy Knowledge Bases, Advances in Fuzzy Systems (2001), World Scientific: World Scientific Singapore · Zbl 1042.68098
[6] Y. Freund, R.E. Schapire, Experiments with a new boosting algorithm, in: Proc. 13th Int. Conf. on Machine Learning ML-96, 1996.; Y. Freund, R.E. Schapire, Experiments with a new boosting algorithm, in: Proc. 13th Int. Conf. on Machine Learning ML-96, 1996.
[7] González, A.; Herrera, F., Multi-stage genetic fuzzy systems based on the iterative rule learning approach, Mathware Soft Comput., 4, 233-249 (1997) · Zbl 0893.68121
[8] González, A.; Pérez, R., Completeness and consistency conditions for learning fuzzy rules, Fuzzy Sets and Systems, 96, 37-51 (1998)
[9] Ishibuchi, H.; Nozaki, K.; Yamamoto, N.; Tanaka, H., Selecting fuzzy if-then rules for classification problems using genetic algorithms, IEEE Trans. Fuzzy Systems, 3, 3, 260-270 (1995)
[10] Ishibuchi, H.; Nakashima, T.; Morisawa, T., Voting in fuzzy rule-based systems for pattern classification problems, Fuzzy Sets and Systems, 103, 223-238 (1999)
[11] Junco, L.; Sanchez, L., Using the adaboost algorithm to induce fuzzy rules in classification problems, (Proc. Spanish Conf. for Fuzzy Logic and Technologies (ESTYLF 2000) (2000), Sevilla: Sevilla Spain), 297-301
[12] Karr, C., Genetic algorithms for fuzzy controllers, AI Expert, 6, 2, 26-33 (1991)
[13] Nauck, D.; Kruse, R., A neuro-fuzzy method to learn fuzzy classification rules from data, Fuzzy Sets and Systems, 89, 277-288 (1997)
[14] Ripley, B. D., Pattern Classification and Neural Networks (1996), Cambridge University Press: Cambridge University Press Cambridge · Zbl 0853.62046
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.