×

An approach for on-line extraction of fuzzy rules using a self-organising fuzzy neural network. (English) Zbl 1067.68128

Summary: This paper presents a hybrid neural network, called the self-organising fuzzy neural network (SOFNN), to extract fuzzy rules from the training data. The first hidden layer of this network consists of Ellipsoidal Basis Function (EBF) neurons. Every EBF neuron in the SOFNN has both a centre vector and a width vector. Neurons are organised by the network itself. The methods of the structure and parameter learning, based on new adding and pruning techniques and a recursive learning algorithm, are simple and effective, with a high accuracy and a compact structure. Simulations show that the SOFNN has the capability to encode fuzzy rules in the resulting network.

MSC:

68T05 Learning and adaptive systems in artificial intelligence
PDF BibTeX XML Cite
Full Text: DOI

References:

[1] Andrews, R.; Diederich, J.; Tickle, A.B., A survey and critique of techniques for extracting rules from trained artificial neural networks, Knowledge based systems, 8, 373-389, (1995)
[2] Astrom, K.J.; Wittenmark, B., Adaptive control, (1995), Addison-Wesley Reading, MA · Zbl 0217.57903
[3] Box, G.E.P.; Jenkins, G.M., Time series analysis, forecasting and control, (1976), Holden Day San Francisco · Zbl 0109.37303
[4] Brown, M.D.; Lightbody, G.; Irwin, G.W., Nonlinear internal model control using local model networks, IEE proc.: control theory appl., 144, 505-514, (1997)
[5] Buckley, J.J.; Hayashi, Y., Fuzzy neural networksa survey, Fuzzy sets and systems, 66, 1-13, (1994)
[6] G. Castellano, A.M. Fanelli, A self-organizing neural fuzzy inference network, in: Proc. IEEE Internat. J. Conf. on Neural Networks (IJCNN 2000), vol. 5, Italy, 2000, pp. 14-19.
[7] Chao, C.T.; Chen, Y.J.; Teng, C.C., Simplification of fuzzy-neural systems using similarity analysis, IEEE trans. systems man cybernet., P. B: cybernet., 26, 344-354, (1996)
[8] Chen, M.; Linkens, D.A., A systematic neuro-fuzzy modelling framework with application to material property prediction, IEEE trans. systems man cybernet., P. B: cybernet., 31, 781-790, (2001)
[9] Chen, S.; Cowan, C.F.N.; Grant, P.M., Orthogonal least squares learning algorithm for radial basis function network, IEEE trans. neural networks, 2, 302-309, (1991)
[10] Cheng, C.C.; Hsieh, W.H., The fuzzy crystallization algorithma new approach to complex systems modeling, IEEE trans. systems man cybernet., P. B: cybernet., 31, 891-901, (2001)
[11] Cho, K.B.; Wang, B.H., Radial basis function based adaptive fuzzy systems and their applications to identification and prediction, Fuzzy sets and systems, 83, 325-339, (1996)
[12] Franklin, G.F.; Powell, J.D.; Workman, M.L., Digital control of dynamic systems, (1990), Addison-Wesley Reading, MA · Zbl 0697.93002
[13] R.C. Hall, D.E. Seborg, Modelling and self-tuning control of a multivariable pH neutralization process. Part I: modelling and multiloop control, Proc. Amer. Control Conf., Pittsburgh, 1989, pp. 1822-1827.
[14] B. Hassibi, D.G. Stork, Second-order derivatives for network pruning: optimal brain surgeon, in: S.J. Hanson, J.D. Cowan, C.L. Giles (Eds.), Advances in Neural Information Processing 5, Morgan Kaufman, Los Altos, CA, 1993, pp. 164-171.
[15] Horikawa, S.; Furuhashi, T.; Uchikawa, Y., On fuzzy modeling using fuzzy neural networks with the back-propagation algorithm, IEEE trans. neural networks, 3, 801-806, (1992)
[16] Hornik, K.; Stinchcombe, M.; White, H., Multilayer feedforward networks are universal approximators, Neural networks, 2, 359-366, (1989) · Zbl 1383.92015
[17] Jang, J.S.R., Anfisadaptive-network-based fuzzy inference system, IEEE trans. systems man cybernet., 23, 665-684, (1993)
[18] Jang, J.S.R., Neuro-fuzzy and soft computing: A computational approach to learning and machine intelligence, (1997), Prentice-Hall Englewood Cliffs, NJ
[19] Jang, J.S.R.; Sun, C.T., Functional equivalence between radial basis function networks and fuzzy inference systems, IEEE trans. neural networks, 4, 156-159, (1993)
[20] Juang, C.F.; Lin, C.T., An on-line self-constructing neural fuzzy inference network and its applications, IEEE trans. fuzzy systems, 6, 12-32, (1998)
[21] Kadirkamanathan, V.; Niranjan, M., A function estimation approach to sequential learning with neural networks, Neural comput., 5, 95-975, (1993)
[22] Kim, E.; Park, M.; Ji, S.; Park, M., A new approach to fuzzy modeling, IEEE trans. fuzzy systems, 5, 328-337, (1997)
[23] Lee, C.C., Fuzzy logic in control systemsfuzzy logic controller—part I and II, IEEE trans. systems man cybernet., 20, 404-435, (1990)
[24] G. Leng, G. Prasad, T.M. McGinnity, A new approach to generate a self-organizing fuzzy neural network model, in: Proc. IEEE Internat. Conf. on Systems, Man, and Cybernetics, 2002.
[25] Leung, C.S.; Wong, K.W.; Sum, P.F.; Chan, L.W., A pruning method for the recursive least squared algorithm, Neural networks, 14, 147-174, (2001)
[26] Li, R.P.; Mukaidono, M., A new approach to rule learning based on fusion of fuzzy logic and neural networks, IEICE trans. inform. systems, E78-d, 1509-1514, (1995)
[27] Lu, Y.; Sundararajan, N.; Saratchandran, P., A sequential learning scheme for function approximation using minimal radial basis function neural networks, Neural computation, 9, 461-478, (1997) · Zbl 1067.68586
[28] Nahas, E.P.; Henson, M.A.; Seborg, D.E., Nonlinear internal model control strategy for neural network model, Comput. chem. engrg., 16, 1039-1057, (1992)
[29] D. Nauck, Neuro-fuzzy systems: review and prospects, Proc. 5th European Congr. on Intelligent Techniques and Soft Computing (EUFIT’97), 1997, pp. 1044-1053.
[30] Pedrycz, W., An identification algorithms in fuzzy relational systems, Fuzzy sets and systems, 13, 153-167, (1984) · Zbl 0554.93070
[31] Platt, J., A resource-allocating network for function interpolation, Neural comput., 3, 213-225, (1991)
[32] Rojas, I.; Pomares, H.; Bernier, J.L.; Ortega, J.; Pino, B.; Pelayo, F.J.; Prieto, A., Time series analysis using normalized PG-RBF network with regression weights, Neurocomputing, 42, 267-285, (2002) · Zbl 1002.68708
[33] Sugeno, M.; Kang, G.T., Structure identification of fuzzy model, Fuzzy sets and systems, 28, 15-33, (1988) · Zbl 0652.93010
[34] Sugeno, M.; Yasukawa, T., A fuzzy-logic-based approach to qualitative modeling, IEEE trans. fuzzy systems, 1, 7-31, (1993)
[35] Sugeno, S.; Tanaka, K., Successive identification of a fuzzy model and its applications to prediction of a complex system, Fuzzy sets and systems, 42, 315-334, (1991) · Zbl 0741.93052
[36] Takagi, T.; Sugeno, M., Fuzzy identification of systems and its applications to modeling and control, IEEE trans. systems man cybernet., 15, 116-132, (1985) · Zbl 0576.93021
[37] Tickle, A.B.; Andrews, R.; Golea, M.; Diederich, J., The truth will come to lightdirections and challenges in extracting the knowledge embedded within trained artificial neural networks, IEEE trans. neural networks, 9, 1057-1068, (1998)
[38] Tong, R.M., The construction and evaluation of fuzzy models, (), 559-576
[39] Wang, L.; Langari, R., Complex systems modeling via fuzzy logic, IEEE trans. systems man cybernet., P. B: cybernet., 26, 100-106, (1996)
[40] Wang, L.; Mendel, J.M., Fuzzy basis functions, universal approximation, and orthogonal least-squares learning, IEEE trans. neural networks, 3, 807-814, (1992)
[41] Wang, W.J., New similarity measures on fuzzy sets and on elements, Fuzzy sets and systems, 85, 305-309, (1997) · Zbl 0904.04009
[42] Wu, S.; Er, M.J., Dynamic fuzzy neural networks—a novel approach to function approximation, IEEE trans. systems man cybernet., P. B: cybernet., 30, 358-364, (2000)
[43] Wu, S.; Er, M.J.; Gao, Y., A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks, IEEE trans. fuzzy systems, 9, 578-594, (2001)
[44] Xu, C.; Lu, Y., Fuzzy model identification and self learning for dynamic systems, IEEE trans. systems man cybernet., 17, 683-689, (1987) · Zbl 0643.93018
[45] Zadeh, L.A., Outline of a new approach to the analysis of complex systems and decision processes, IEEE trans. systems man cybernet., 3, 28-44, (1973) · Zbl 0273.93002
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.