Consistent nonlinear dynamics: identifying model inadequacy. (English) Zbl 1059.37064

Summary: Empirical modelling often aims for the simplest model consistent with the data. A new technique is presented which quantifies the consistency of the model dynamics as a function of location in state space. As is well known, traditional statistics of nonlinear models like root-mean-square (RMS) forecast error can prove misleading. Testing consistency is shown to overcome some of the deficiencies of RMS error, both within the perfect model scenario and when applied to data from several physical systems using previously published models. In particular, testing for consistent nonlinear dynamics provides insight towards (i) identifying when a delay reconstruction fails to be an embedding, (ii) allowing state-dependent model selection and (iii) optimising local neighbourhood size. It also provides a more relevant (state dependent) threshold for identifying false nearest neighbours.


37M10 Time series analysis of dynamical systems
93E99 Stochastic systems and control
Full Text: DOI arXiv


[1] R.P. Feynman, The Character of Physical Law, Penguin Books, London, 1992.
[2] C. Chatfield, The Analysis of Time Series, 4th ed., Chapman & Hall, London, 1989. · Zbl 0732.62088
[3] McSharry, P.E.; Smith, L.A., Better nonlinear models from noisy data: attractors with maximum likelihood, Phys. rev. lett., 83, 21, 4285-4288, (1999)
[4] L.A. Smith, The maintenance of uncertainty, in: G. Cini (Ed.), Nonlinearity in Geophysics and Astrophysics, vol. CXXXIII of International School of Physics “Enrico Fermi”, Bologna, Italy, Società Italiana di Fisica, 1997, pp. 177-246.
[5] L.A. Smith, Disentangling uncertainty and error: on the predictability of nonlinear systems, in: A.I. Mees (Ed.), Nonlinear Dynamics and Statistics, Birkhauser, Boston, 2000, pp. 31-64.
[6] Grebogi, C.; Hammel, S.M.; Yorke, J.A.; Sauer, T., Shadowing of physical trajectories in chaotic dynamics: containment and refinement, Phys. rev. lett., 65, 1527-1530, (1990) · Zbl 1050.37521
[7] Palmer, T.N., Predicting uncertainty in forecasts of weather and climate, Rep. prog. phys., 63, 71-116, (2000)
[8] Orrell, D.; Smith, L.A.; Barkmeijer, J.; Palmer, T.N., Model error in weather forecasting, Nonlinear process. geophys., 8, 6, 357-371, (2001)
[9] H. Kantz, T. Schreiber, Nonlinear Time Series Analysis, Cambridge University Press, Cambridge, 1997. · Zbl 0873.62085
[10] Farmer, J.D.; Sidorowich, J.J., Predicting chaotic time series, Phys. rev. lett., 59, 8, 845-848, (1987)
[11] M.B. Priestly, Spectral Analysis and Time Series, Academic Press, London, 1981.
[12] Broomhead, D.S.; Lowe, D., Multivariable functional interpolation and adaptive networks, J. complex syst., 2, 321-355, (1988) · Zbl 0657.68085
[13] Casdagli, M., Nonlinear prediction of chaotic time series, Physica D, 35, 335-356, (1989) · Zbl 0671.62099
[14] Smith, L.A., Identification and prediction of low-dimensional dynamics, Physica D, 58, 50-76, (1992) · Zbl 1194.37142
[15] Kennel, M.B.; Brown, R.; Abarbanel, H.D.I., Determining embedding dimension for the phase-space reconstruction using a geometrical construction, Phys. rev. A, 45, 6, 3403-3411, (1992)
[16] H. Tong, Non-Linear Time Series Analysis, Oxford University Press, Oxford, 1990.
[17] Kostelich, E.J.; Yorke, J.A., Noise-reduction—finding the simplest dynamic system consistent with the data, Physica D, 41, 2, 183-196, (1990) · Zbl 0705.58036
[18] K. Judd, L.A. Smith, Indistinguishable states. II. Imperfect model scenario, Physica D, submitted for publication. · Zbl 1081.62074
[19] Beven, K.J., Equifinality, data assimilation, and uncertainty estimation in mechanistic modelling of complex environmental systems, J. hydrol., 249, 11-29, (2001)
[20] Beven, K.J., Towards a coherent philosophy for modelling the environment, Proc. roy. soc. A, 458, 2465-2484, (2002) · Zbl 1009.62105
[21] D. Orrell, Modelling nonlinear dynamical systems: chaos, uncertainty, and error, Ph.D. Thesis, University of Oxford, 2001.
[22] Schroer, C.G.; Sauer, T.; Ott, E.; Yorke, J.A., Predicting chaos most of the time from embeddings with self-intersections, Phys. rev. lett., 80, 7, 1410-1413, (1998)
[23] P.E. McSharry, Innovations in consistent nonlinear deterministic prediction, Ph.D. Thesis, University of Oxford, 1999.
[24] F. Takens, Detecting strange attractors in fluid turbulence, in: D. Rand, L.S. Young (Eds.), Dynamical Systems and Turbulence, vol. 898, Springer-Verlag, New York, 1981, p. 366. · Zbl 0513.58032
[25] Sauer, T.; Yorke, J.A.; Casdagli, M., Embedology, J. statist. phys., 65, 579-616, (1991) · Zbl 0943.37506
[26] W.H. Press, B.P. Flannery, S.A. Teukolsky, W.T. Vetterling, Numerical Recipes in C, 2nd ed., Cambridge University Press, Cambridge, 1992. · Zbl 0778.65003
[27] Ikeda, K., Multiple-valued stationary state and its instability of the transmitted light by a ring cavity system, Opt. commun., 30, 2, 257-261, (1979)
[28] Ikeda, K.; Daido, H., Optical turbulence: chaotic behaviour of transmitted light from a ring cavity, Phys. rev. lett., 45, 9, 709-712, (1980)
[29] Hammel, S.M.; Jones, C.K.R.T.; Moloney, J.V., Global dynamical behaviour of the optical field in a ring cavity, J. opt. soc. am. B, 2, 4, 552-564, (1985)
[30] Smith, L.A., Local optimal prediction: exploiting strangeness and the variation of sensitivity to initial condition, Phil. trans. R. soc. London A, 348, 1688, 371-381, (1994) · Zbl 0859.62085
[31] Bollt, E.M., Model selection, confidence, and scaling in predicting chaotic time-series, Int. J. bifurc. chaos, 10, 6, 1407-1422, (2000) · Zbl 1090.34604
[32] J.L. Kaplan, J.A. Yorke, Chaotic behaviour of multidimensional difference equations, in: H.O. Peitgen, H.O. Walter (Eds.), Functional Differential Equations and Approximation of Fixed Points, vol. 730 of Lecture Notes in Mathematics, Springer, Berlin, 1979, p. 204.
[33] Rulkov, N.F.; Tsimring, L.S.; Abarbanel, H.D.I., Tracking unstable orbits in chaos using dissipative feedback control, Phys. rev. E, 50, 1, 314-324, (1994)
[34] Timmer, J.; Rust, H.; Horbelt, W.; Voss, H.U., Parametric, nonparametric and parametric modelling of a chaotic circuit time series, Phys. lett. A, 274, 123-134, (2000) · Zbl 1055.37586
[35] Haken, H., Analogy between higher instabilities in fluids and lasers, Phys. lett. A, 53, 77, (1975)
[36] U. Hübner, C.O. Weiss, N.B. Abraham, D. Tsang, Lorenz-like chaos in nh_{3}-fir lasers, in: A. Weigend, N. Gershenfeld (Eds.), Time Series Prediction: Forecasting the Future and Understanding the Past, vol. XV of SFI Studies in Complexity, Addison-Wesley, New York, 1993, pp. 323-344.
[37] A.S. Weigend, N.A. Gershenfeld, Time Series Prediction: Forecasting the Future and Understanding the Past, vol. XV of SFI Studies in Complexity, Addison-Wesley, New York, 1993.
[38] L.A. Smith, Does a meeting in Santa Fe imply chaos? in: A. Weigend, N. Gershenfeld (Eds.), Time Series Prediction: Forecasting the Future and Understanding the Past, vol. XV of SFI Studies in Complexity, Addison-Wesley, New York, 1993, pp. 323-344.
[39] Flepp, L.; Holzner, R.; Brun, E.; Finardi, M.; Badii, R., Model identification by periodic-orbit analysis for NMR-laser chaos, Phys. rev. lett., 67, 2244-2247, (1991)
[40] Read, P.L., Applications of singular systems to ‘baroclinic chaos’, Physica D, 58, 455-468, (1992)
[41] Hide, R., An experimental study of thermal convection in a rotating liquid, Phil. trans. R. soc. A, 250, 441-478, (1958)
[42] Lorenz, E.N., Deterministic nonperiodic flow, J. atmos. sci., 20, 130-141, (1963) · Zbl 1417.37129
[43] L.A. Smith, Predictability past predictability present, in: Seminar on Predictability, ECMWF, Reading, UK, 2003, pp. 219-242.
[44] Rapp, P.E.; Schmah, T.I.; Mees, A.I., Models of knowing and the investigation of dynamical systems, Physica D, 132, 133-149, (1999) · Zbl 0940.37021
[45] F. Kwasniok, L.A. Smith, Real-time construction of optimized predictors from data streams, Phys. Rev. Lett., accepted (2004).
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.