Identification of models for chaotic systems from noisy data: implications for performance and nonlinear filtering. (English) Zbl 0888.93015

Summary: This paper investigates the identification of global models from chaotic data corrupted by additive noise. It is verified that noise has a strong influence on the identification of chaotic systems. In particular, there seems to be a critical noise level beyond which the accurate estimation of polynomial models from chaotic data becomes very difficult. Similarities with the estimation of the largest Lyapunov exponent from noisy data suggest that part of the problem might be related to the limited ability of predicting the data records when these are chaotic. A nonlinear filtering scheme is suggested in order to reduce the noise in the data and thereby enable the estimation of good models. This prediction-based filtering incorporates a resetting mechanism which enables the filtering of chaotic data and which is also applicable to non-chaotic data.


93B30 System identification
37D45 Strange attractors, chaotic dynamics of systems with hyperbolic behavior
93E11 Filtering in stochastic control theory
93C10 Nonlinear systems in control theory
Full Text: DOI


[1] Billings, S. A., Identification of nonlinear systems - a survey, (IEE Proc. Pt. D, 127 (1980)), 272-285
[2] Leontaritis, I. J.; Billings, S. A., Input-output parametric models for nonlinear systems part I: deterministic nonlinear systems, Int. J. Control, 41, 303-328 (1985) · Zbl 0569.93011
[3] Aguirre, L. A.; Billings, S. A., Dynamical effects of overparametrization in nonlinear models, Physica D, 80, 26-40 (1995) · Zbl 0888.58060
[4] Farmer, J. D.; Sidorowich, J. J., Exploiting chaos to predict the future and reduce noise, (Lee, Y. C., Evolution, Learning and Cognition (1988), World Scientific: World Scientific Singapore)
[5] Crutchfield, J. P.; McNamara, B. S., Equations of motion from a data series, Complex Systems, 1, 417-452 (1987) · Zbl 0675.58026
[6] Leontaritis, I. J.; Billings, S. A., Input-output parametric models for nonlinear systems part II: stochastic nonlinear systems, Int. J. Control, 41, 329-344 (1985) · Zbl 0569.93012
[7] Chen, S.; Billings, S. A., Representations of nonlinear systems: the NARMAX model, Int. J. Control, 49, 1013-1032 (1989) · Zbl 0674.93009
[8] Chen, S.; Billings, S. A.; Luo, W., Orthogonal least squares methods and their application to nonlinear system identification, Int. J. Control, 50, 1873-1896 (1989) · Zbl 0686.93093
[9] Billings, S. A.; Korenberg, M. J.; Chen, S., Identification of nonlinear output affine systems using an orthogonal least squares algorithm, Int. J. Systems Sci., 19, 1559-1568 (1988) · Zbl 0669.93015
[10] Korenberg, M. J.; Paarmann, L. D., Orthogonal approaches to time-series analysis and system identification, IEEE Signal Processing Magazine, 8, 29-43 (1991)
[11] Korenberg, M. J.; Billings, S. A.; Liu, Y. P.; Mcllroy, P. J., Orthogonal parameter estimation algorithm for nonlinear stochastic systems, Int. J. Control, 48, 193-210 (1988) · Zbl 0647.93062
[12] Haber, R.; Unbehauen, H., Structure identification of nonlinear dynamic systems — A survey on input/output approaches,, Automatica, 26, 651-677 (1990) · Zbl 0721.93023
[13] Aguirre, L. A.; Billings, S. A., Improved structure selection for nonlinear models based on term clustering, Int. J. Control (1995), accepted · Zbl 0837.93009
[14] Billings, S. A.; Voon, W. S.F., Correlation based model validity tests for non-linear models, Int. J. Control, 44, 235-244 (1986) · Zbl 0589.93066
[15] Billings, S. A.; Tao, Q. H., Model validation tests for nonlinear signal processing applications, Int. J. Control, 54, 157-194 (1991) · Zbl 0734.62089
[16] Abarbanel, H. D.I.; Brown, R.; Kadtke, J. B., Prediction in chaotic nonlinear systems: Methods for time series with broadband Fourier spectra, Phys. Rev. A, 41, 1782-1807 (1990)
[17] Principe, J. C.; Rathie, A.; Kuo, J. M., Prediction of chaotic time series with neural networks and the issue of dynamic modeling, Int. J. Bifurcation and Chaos, 2, 989-996 (1992) · Zbl 0900.62497
[18] Aguirre, L. A.; Billings, S. A., Validating identified nonlinear models with chaotic dynamics, Int. J. Bifurcation and Chaos, 4, 109-125 (1994) · Zbl 0876.58028
[19] Casdagli, M., Nonlinear prediction of chaotic time series, Physica D, 35, 335-356 (1989) · Zbl 0671.62099
[20] Aguirre, L. A.; Billings, S. A., Retrieving dynamical invariants from chaotic data using NARMAX models, Int. J. Bifurcation and Chaos (1995), accepted · Zbl 0886.58100
[21] Chua, L. O., The genesis of Chua’s circuit, Archiv für Elektronik und Übertragungstechnik, 46, 250-257 (1992)
[22] (Chua, L. O.; Hasler, M., Special issue on Chaos in nonlinear electronic circuits. Special issue on Chaos in nonlinear electronic circuits, IEEE Trans. Circuits Syst., 40 (1993))
[23] Ueda, Y., Random phenomena resulting from nonlinearity in the system described by Duffing’s equation, Int. J. Non-Linear Mech, 20, 481-491 (1985)
[24] Wolf, A.; Swift, J. B.; Swinney, H. L.; Vastano, J. A., Determining Lyapunov exponents from a time series, Physica D, 16, 285-317 (1985) · Zbl 0585.58037
[25] Moon, F. C., Chaotic Vibrations - an introduction for applied scientists and engineers (1987), Wiley: Wiley New York · Zbl 0745.58003
[26] Nicolis, C.; Nicolis, G., Finite time behavior of small errors in deterministic chaos and Lyapunov exponents, Int. J. Bifurcation and Chaos, 3, 1339-1342 (1993) · Zbl 0885.58051
[27] Rosenstein, M. T.; Collins, J. J.; De Luca, C. J., A practical method for calculating largest Lyapunov exponents from small data sets, Physica D, 65, 117-134 (1993) · Zbl 0779.58030
[28] Brown, R.; Bryant, P.; Abarbane, H. D.I., Computing the Lyapunov spectrum of a dynamical system from an observed time series, Phys. Rev. A, 43, 2787-2806 (1991)
[29] Casdagli, M.; Eubank, S.; Farmer, J. D.; Gibson, J., State space reconstruction in the presence of noise, Physica D, 51, 52-98 (1991) · Zbl 0736.62075
[30] Grassberger, P.; Schreiber, J.; Schaffrath, C., Nonlinear time sequence analysis, Int. J. Bifurcation and Chaos, 1, 521-547 (1991) · Zbl 0874.58029
[31] Badii, R.; Broggi, G.; Derighetti, B.; Ravani, M.; Ciliberto, S.; Politi, A.; Rubio, M. A., Dimension increase in filtered chaotic signals, Phys. Rev. Lett., 60, 979-982 (1988)
[32] Mitschke, F., Acausal filters for chaotic signals, Phys. Rev. A, 41, 1169-1171 (1990)
[33] Chennaoui, A.; Pawelzik, K.; Liebert, W.; Schuster, G. H.; Pfister, G., Attractor reconstruction from filtered chaotic time series, Phys. Rev. A, 41, 4151-4159 (1990)
[34] Broomhead, D. S.; Huke, J. P.; Muldoon, M. R., Linear filters and nonlinear systems, J.R. Stat. Soc. B, 54, 373-382 (1992) · Zbl 0773.60029
[35] Davies, M. E., An iterated function approximation in shadowing time series, Phys. Lett., 169 A, 251-258 (1992)
[36] Davies, M. E., Noise reduction by gradient descent, Int. J. Bifurcation and Chaos, 3, 113-118 (1992) · Zbl 0875.62414
[37] Sauer, T., A noise reduction method for signals from nonlinear systems, Physica D, 58, 193-201 (1992) · Zbl 1194.94137
[38] Grassberger, P.; Hegger, R.; Kantz, H.; Schaffrath, C., On noise reduction methods for chaotic data, Chaos, 3, 127-141 (1993) · Zbl 1055.37585
[39] Farmer, J. D.; Sidorowich, J. J., Optimal shadowing and noise reduction, Physica D, 47, 373-392 (1991) · Zbl 0729.65501
[40] Kostelich, E. J.; Yorke, J. A., Noise reduction in dynamical systems, Phys. Rev. A, 38, 1649-1652 (1988)
[41] Kostelich, E. J.; Yorke, J. A., Noise reduction: Finding the simplest dynamical system consistent with the data, Physica D, 41, 183-196 (1990) · Zbl 0705.58036
[42] Billings, S. A.; Voon, W. S.F., Least squares parameter estimation algorithms for nonlinear systems, Int. J. Systems Sci., 15, 601-615 (1984) · Zbl 0567.93062
[43] Schreiber, T.; Grassberger, P., A simple noise-reduction method for real data, Phys. Lett. A, 160, 411-418 (1991)
[44] Aguirre, L. A.; Mendes, E. M.; Billings, S. A., Smoothing data with local instabilities for the identification of chaotic systems, Int. J. Control (1995), accepted
[45] Akaike, H., A new look at the statistical model identification, IEEE Trans. Automat. Contr., 19, 716-723 (1974) · Zbl 0314.62039
[46] Mees, A. I., Parsimonious dynamical reconstruction, Int. J. Bifurcation and Chaos, 3, 669-675 (1993) · Zbl 0875.62426
[47] Gooijer, J. G.; Abraham, B.; Gould, A.; Robinson, L., Methods for determining the order of an autoregressive-moving average process: a survey, Int. Statistical Review, 53, 301-329 (1985) · Zbl 0586.62145
[48] Farmer, J. D., Sensitive dependence on parameters in nonlinear dynamics, Phys. Rev. Lett., 55, 351-354 (1985)
[49] Brown, R.; Chua, L. O.; Popp, B., Is sensitive dependence on initial conditions nature’s sensory device?, Int. J. Bifurcation and Chaos, 2, 193-199 (1992) · Zbl 0876.58034
[50] Gallas, J. A.C.; Grebogi, C.; Yorke, J., Vertices in parameter space: Double crises which destroy chaotic attractors, Phys. Rev. Lett., 71, 1359-1362 (1993)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.