Dynamical behaviors of Cohen-Grossberg neural networks with discontinuous activation functions. (English) Zbl 1078.68127

Lu, Wenlian; Chen, Tianping

Neural Netw. 18, No. 3, 231-242 (2005).

Summary: We discuss dynamics of Cohen-Grossberg neural networks with discontinuous activations functions. We provide a relax set of sufficient conditions based on the concept of Lyapunov diagonal stability for Cohen-Grossberg networks to be absolutely stable. Moreover, under certain conditions we prove that the system is exponentially stable globally or convergent globally in finite time. Convergence rate for global exponential convergence and convergence time for global convergence in finite time are also provided.

MSC:

68T05

Learning and adaptive systems in artificial intelligence

Keywords:

Cohen-Grossberg neural networks; Differential inclusions; Set-valued map; Filippov solution; Lyapunov diagonally stable; Global stability

References:

[1]	Amari, S., Characteristics of randomly connected threshold element networks and neural systems, Proceedings of IEEE, 59, 1, 35-47, (1971)
[2]	Amari, S., Characteristics of random nets of analog neuron-like elements, IEEE transactions on systems, man, and cybernectics, 2, 643-657, (1972) · Zbl 0247.92006
[3]	Aubin, J.P., Viability theory, (1991), Birhauser Boston · Zbl 0755.93003
[4]	Aubin, J.P.; Cellina, A., Differential inclusions, (1984), Springer Berlin
[5]	Aubin, J.P.; Frankowska, H., Set-valued analysis, (1990), Birkhauser Boston
[6]	Baciotti, A.; Conti, R.; Marcellini, P., Discontinuous ordinary differential equations and stabilization, (2000), Universita di Firenze
[7]	Chen, T.; Amari, S., Stability of asymmetric Hopfield networks, IEEE transactions on neural networks, 12, 1, 159-163, (2001)
[8]	Chen, T.; Lu, W.; Amari, S., Global convergence rate of recurrently connected neural networks, Neural computation, 14, 2947-2958, (2002) · Zbl 1079.68584
[9]	Chen, T.; Rong, L., Robust global exponential stability of cohen – grossberg neural networks with time-delays, IEEE transactions on neural networks, 15, 1, 203-206, (2004)
[10]	Chua, L.O.; Desoer, C.A.; Kuh, E.S., Linear and nonlinear circuits, (1987), Macgraw-Hill New York · Zbl 0631.94017
[11]	Clarke, F.H., Optimization and nonsmooth analysis, (1983), Wiley New York · Zbl 0727.90045
[12]	Cohen, M.A.; Grossberg, S., Absolute stability and global pattern formation and parallel storage by competitive neural networks, IEEE transactions on systems, man, and cybernectics, 13, 815-826, (1983) · Zbl 0553.92009
[13]	Filippov, A.F., Differential equations with discontinuous right-hand side. mathematics and its applications (soviet series), (1988), Kluwer Academic Publishers Boston
[14]	Forti, M., On global asymptotic stability of a class of nonlinear arising in neural networks theory, Journal of differential equations, 113, 246-264, (1994) · Zbl 0828.34039
[15]	Forti, M.; Manetti, S.; Marini, M., A condition for global convergence of a class of symmetric neural networks, IEEE transactions on circuits and systems, 39, 480-483, (1992) · Zbl 0775.92005
[16]	Forti, M.; Tesi, A., New condition for global stability of neural networks with application to linear quadratic programming problems, IEEE transactions on circuits and systems—1, 42, 354-366, (1995) · Zbl 0849.68105
[17]	Forti, M.; Nistri, P., Global convergence of neural networks with discontinuous neuron activations, IEEE trans. circuits syst.-1, 50, 11, 1421-1435, (2003) · Zbl 1368.34024
[18]	Grossberg, S., Nonlinear neural networks principles, mechanisms, and architectures, Neural networks, 1, 17-66, (1988)
[19]	Harrer, H.; Nossek, J.A.; Stelzl, R., An analog implementation of discrete-time neural networks, IEEE transactions on neural networks, 3, 466-476, (1992)
[20]	Hirsh, M., Convergence activation dynamics in continuous time networks, Neural networks, 2, 331-349, (1989)
[21]	Hopfield, J.J., Neurons with graded response have collective computational properties like those of two-stage neurons, Proceedings of the national Academy science-biology, 81, 3088-3092, (1984) · Zbl 1371.92015
[22]	Hopfield, J.J.; Tank, D.W., Computing with neural circuits: A model, Science, 233, 625-633, (1986) · Zbl 1356.92005
[23]	Horn, R.A.; Johnson, C.R., Matrix analysis, (1985), Cambridge University Press New York · Zbl 0576.15001
[24]	Joy, M.P., On the global convergence of a class of functional differential equations with applications in neural network theory, Journal of mathematical analysis and applications, 232, 61-81, (1999) · Zbl 0958.34057
[25]	Kaszkurewicz, E.; Bhaya, A., On a class of global stable neural circuits, IEEE transactions on circuits and sytstems—1, 41, 171-174, (1994) · Zbl 0843.93063
[26]	Kelly, D.G., Stability in contractive nonlinear neural networks, Transactions on biomedical engineering, 3, 231-242, (1990)
[27]	Kennedy, M.P.; Chua, L.O., Neural networks for nonlinear programming, IEEE transactions on circuits and systems—1, 35, 554-562, (1988)
[28]	Liang, X.; Wang, J., An additive diagonal stability condition for absolute stability of a general class of neural networks, IEEE transactions on circuits and systems I, 42, 354-366, (2001)
[29]	Lu, W.; Rong, L.; Chen, T., Global convergence of delayed neural network systems, International journal of neural systems, 13, 3, 193-204, (2003)
[30]	Lu, W.; Chen, T., New conditions global stability of cohen – grossberg neural networks, Neural computation, 15, 1173-1189, (2003) · Zbl 1086.68573
[31]	Matsuoka, K., Stability condition for nonlinear neural networks with asymmetric connection weight, Neural networks, 5, 495-500, (1992)
[32]	Michel, A.N.; Farrel, J.A.; Porod, W., Qualitative analysis of neural networks, IEEE transactions on circuits and systems, 36, 229-243, (1989) · Zbl 0672.94015
[33]	Michel, A.N.; Gray, D.L., Analysis and synthesis of neural networks with lower block triangular interconnecting structure, IEEE transactions on circuits and systems, 37, 1267-1283, (1990)
[34]	Miller, R.K.; Michel, A.N., Ordinary differential equations, (1982), Academic Press Orlando, FL · Zbl 0499.34024
[35]	Paden, B.E.; Sastry, S.S., Calculus for computing Filippov’s differential inclusion with application to the variable structure control of robot manipulator, IEEE transactions on circuits and systems, 34, 73-82, (1987) · Zbl 0632.34005
[36]	Sompolinsky, H.; Crisanti, A., Chaos in random neural networks, Physical review letters, 61, 259-262, (1988)
[37]	Spraker, J.S.; Biles, D.C., A comparison of the Carathéodory and Filippov solution sets, Journal of mathematical analysis and applications, 198, 571-580, (1996) · Zbl 0854.34012
[38]	Utkin, V.I., Sliding modes and their applications in variable structure systems, (1978), MIR Publishers Moskow · Zbl 0398.93003
[39]	Wilson, H.; Cowan, A., Excitatory and inhibitory interactions in localized populations of model neurons, Biophysical journal, 12, 1-24, (1972)
[40]	Wang, L.; Zou, X., Exponential stability of cohen – grossberg neural networks, Neural networks, 15, 415-422, (2002)
[41]	Yang, H.; Dillon, T., Exponential stability and oscillation of Hopfield graded response neural networks, IEEE transactions on neural networks, 5, 719-729, (1994)