×
Sato, Yuzuru; Akiyama, Eizo; Crutchfield, James P.

Stability and diversity in collective adaptation. (English) Zbl 1149.91305

Physica D 210, No. 1-2, 21-57 (2005).
Summary: We derive a class of macroscopic differential equations that describe collective adaptation, starting from a discrete-time stochastic microscopic model. The behavior of each agent is a dynamic balance between adaptation that locally achieves the best action and memory loss that leads to randomized behavior. We show that, although individual agents interact with their environment and other agents in a purely self-interested way, macroscopic behavior can be interpreted as game dynamics. Application to several familiar, explicit game interactions shows that the adaptation dynamics exhibits a diversity of collective behaviors. The simplicity of the assumptions underlying the macroscopic equations suggests that these behaviors should be expected broadly in collective adaptation. We also analyze the adaptation dynamics from an information-theoretic viewpoint and discuss self-organization induced by the dynamics of uncertainty, giving a novel view of collective adaptation.

Cited in 20 Documents

MSC:

91A22 Evolutionary games
37N25 Dynamical systems in biology
91A26 Rationality and learning in game theory
92D50 Animal behavior
94A15 Information theory (general)

Keywords:

collective adaptation; game theory; information theory; dynamical systems
PDF BibTeX XML Cite
\textit{Y. Sato} et al., Physica D 210, No. 1--2, 21--57 (2005; Zbl 1149.91305)
Full Text: DOI arXiv
  • logo of hbz
  • logo of WorldCat

References:

[1] Winfree, A.T., The geometry of biological time, (1980), Springer Verlag · Zbl 0856.92002
[2] Hofbauer, J.; Sigmund, K., Evolutionary games and population dynamics, (1988), Cambridge University Press Cambridge · Zbl 0709.92015
[3] ()
[4] Bateson, G., Steps to an ecology of mind: collected essays in anthropology, psychiatry, evolution, and epistemology, (1987), Aronson Northvale, N.J.
[5] Rossler, O.E., Chaos in coupled optimizers, Ann. NY acad. sci., 504, 229-240, (1987)
[6] Taiji, M.; Ikegami, T., Dynamics of internal models in game players, Physica, D134, 253-266, (1999) · Zbl 0931.91007
[7] Simon, H.A., The sciences of the artificial, karl Taylor Compton lectures, (1996), MIT Press Cambridge
[8] Holland, J.H., Adaptation in natural and artificial systems, (1992), MIT Press Cambridge, MA
[9] Borgers, T.; Sarin, R., Learning through reinforcement and replicator dynamics, J. econ. th., 77, 1-14, (1997) · Zbl 0892.90198
[10] Fudenberg, D.; Levine, D.K., Theory of learning in games, (1998), MIT Press · Zbl 0939.91004
[11] von Neumann, J.; Morgenstern, O., Theory of games and economic behavior, (1944), Princeton University Press · Zbl 0063.05930
[12] Taylor, P.D.; Jonker, L.B., Evolutionary stable strategies and game dynamics, Math. biosci., 40, 145-156, (1978) · Zbl 0395.90118
[13] Taylor, P.D., Evolutionary stable strategies with two types of players, J. appl. probab., 16, 76-83, (1979) · Zbl 0398.90120
[14] Weibull, J.W., Evolutionary game theory, (1995), MIT Press · Zbl 0879.90206
[15] Sato, Y.; Akiyama, E.; Farmer, J.D., Chaos in learning a simple two-person game, Proc. natl. acad. sci. U.S.A., 99, 4748-4751, (2002) · Zbl 1015.91014
[16] Sato, Y.; Crutchfield, J.P., Coupled replicator equations for the dynamics of learning in multiagent systems, Phys. rev., E67, 015206(R), (2003)
[17] Akiyama, E.; Kaneko, K., Dynamical systems game theory and dynamics of games, Phyisca D, 147, 3-4, 221-258, (2000) · Zbl 1038.91510
[18] Akiyama, E.; Kaneko, K., Dynamical systems game theory II—a new approach to the problem of the social dilemma, Phyisca D, 167, 1-2, 36-71, (2002) · Zbl 1032.91530
[19] Itoh, Y., Random collision models in oriented graphs, J. appl. prob., 16, 36, (1979) · Zbl 0411.92015
[20] Turing, A.M., The chemical basis of morphogenesis, Phil. trans. R. soc. lond. B, 237, 37-72, (1952) · Zbl 1403.92034
[21] Shannon, C.E., The mathematical theory of communication, (1949), The University of Illinois Press · Zbl 1154.94303
[22] McCulloch, W.S., A heterarchy of values determined by the topology of nervous nets, Bull. mathe. biophys., 5, 115-133, (1945)
[23] Skinner, B.F., The behavior of organisms: an experimental analysis, (1938), Appleton-Century New York
[24] Hebb, D.O., The organization of behaviour, (1949), John Wiley and Sons New York
[25] Norman, M.F., Markov processes and learning models, (1972), Academic Press New York · Zbl 0262.92003
[26] Samuel, A.L., Some studies in machine learning using the game of checkers, IBM J. res. dev, 11, 601, (1967)
[27] Sutton, R.S.; Barto, A.G., Reinforcement learning: an introduction, (1998), MIT Press
[28] ()
[29] Aitchison, J., The statistical analysis of compositional data, (1986), Blackburn Press Caldwell, New Jersey · Zbl 0688.62004
[30] Cover, T.M.; Thomas, J.A., Elements of information theory, (1991), John Wiley and Sons Inc. · Zbl 0762.94001
[31] Hofbauer, J., Evolutionary dynamics for bimatrix games: a Hamiltonian system?, J. math. biol., 34, 675-688, (1996) · Zbl 0845.92016
[32] Hopfield, J.J., Neural networks and physical systems with emergent collective computational abilities, Proc. natl. acad. sci. U.S.A., 79, 2554-2558, (1982) · Zbl 1369.92007
[33] Perelomov, A.M., Integrable systems of classical mechanics and Lie algebras, (1990), Birkhauser · Zbl 0717.70003
[34] Yoshida, H., Construction of higher order symplectic integrators, Phys. lett., A150, 262-268, (1990)
[35] Chawanya, T., A new type of irregular motion in a class of game dynamics systems, Prog. theo. phys., 94, 163-179, (1995)
[36] van Nimwegen, E.; Crutchfield, J.P.; Mitchell, M., Statistical dynamics of the royal road genetic algorithm, Theor. comp. sci., 229, 41-102, (1999) · Zbl 0938.68082
[37] Hofbauer, J.; Hutson, V.; Vickers, G.T., Travelling waves for games in economics and biology, Nonlinear anal. theory, methods, appl., 30, 2, 1235-1244, (1997) · Zbl 0892.35076
[38] Shaw, R., The dripping faucet as a model chaotic system, (1984), Aerial Press Santa Cruz, California
[39] Crutchfield, J.P.; Young, K., Inferring statistical complexity, Phys. rev. lett., 63, 105-108, (1989)
[40] Crutchfield, J.P.; Shalizi, C.R., Thermodynamic depth of causal states: objective complexity via minimal representations, Phys. rev. E, 59, 1, 275-283, (1999)
[41] Crutchfield, J.P.; Feldman, D.P., Regularities unseen, randomness observed: levels of entropy convergence, Chaos, 13, 1, 25-54, (2003) · Zbl 1080.94006
[42] Schuster, P.; Sigmund, K.; Hofbauer, J.; Wolff, R., Selfregulation of behavior in animal societies. part I. symmetric contests, Biol. cybern., 40, 1-8, (1981) · Zbl 0465.92016
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.