Modelling the dynamics of nonlinear time series using canonical variate analysis. (English) Zbl 1019.37046

Summary: We report on a novel prediction method of nonlinear time series based on canonical variate analysis (CVA) and radial basis modelling. Nonlinear models of possibly chaotic and noisy systems are constructed from data via a nonlinear CVA of the past and future of the process. The canonical variables give an optimal linear combination of nonlinear coordinates of the past for describing the future. We show how our method can be used for prediction, give a comparison with other methods, and apply our prediction algorithm to simulated data from the Lorenz system and the logistic map, to a laser experimental time series, and to sunspot data. The focus of this work is to obtain models that accurately reflect the dynamics of the system: A model should not only fit data and predict it well, but should also have a dynamical behaviour similar to that of the measured system. The results indicate that the algorithm presented is able to capture the dynamics of complex systems and gives reliable predictions when using only short data sets.


37M10 Time series analysis of dynamical systems
62M10 Time series, auto-correlation, regression, etc. in statistics (GARCH)
Full Text: DOI


[1] Judd, K.; Mees, A.I., On selecting models for nonlinear time series, Physica D, 82, 426-444, (1995) · Zbl 0888.58034
[2] Yu, D.; Lu, W.; Harrison, R.G., Phase-space prediction of chaotic time series, Dynam. stabil. syst., 13, 3, 219-236, (1998) · Zbl 0984.37103
[3] T. Sauer, Time series prediction by using delay coordinate embedding, in: A.S. Weigend, N.A. Gershenfeld (Eds.), Time Series Prediction: Forecasting the Future and Understanding the Past, Addison-Wesley, Reading, MA, 1994, pp. 175-193.
[4] Casdagli, M., Nonlinear prediction of chaotic time series, Physica D, 35, 335-356, (1989) · Zbl 0671.62099
[5] F. Takens, Detecting strange attractors in turbulence, in: D.A. Rand, L.S. Young (Eds.), Dynamical Systems and Turbulence, Vol. 898, Springer, Berlin, 1981, pp. 365-381. · Zbl 0513.58032
[6] W.E. Larimore, Identification and filtering of nonlinear systems using canonical variate analysis, in: M. Casdagli, S. Eubank (Eds.), Nonlinear Modeling and Forecasting, Addison-Wesley, Reading, MA, 1991.
[7] W.E. Larimore, in: T. Katayama, S. Sugimoto (Eds.), Canonical Variate Analysis in Control and Signal Processing, Statistical Methods in Control and Signal Processing, Marcel Dekker, New York, 1997, pp. 83-120. · Zbl 0913.93074
[8] W.E. Larimore, Optimal reduced rank modeling, prediction, monitoring, and control using canonical variate analysis, in: Proceedings of the IFAC 1997 International Symposium on Advanced Control of Chemical Processes, Banff, Canada, 1997, pp. 61-66.
[9] Hotelling, H., Relations between two sets of variates, Biometrika, 28, 321-377, (1936) · Zbl 0015.40705
[10] T.W. Anderson, An Introduction to Multivariate Statistical Analysis, second ed., Wiley, New York, 1984. · Zbl 0651.62041
[11] Gelfand, I.M.; Yaglom, A.M., Calculation of the amount of information about a random function contained in another such function, Am. math. soc. trans. ser., 12, 2, 199-236, (1959) · Zbl 0087.13201
[12] A.M. Yaglom, Outline of some topics in linear extrapolation of stationary random processes, in: Proc. Fifth Berkeley Symp. Math. Stat. and Prob., California Press, California, 1970. · Zbl 0189.18401
[13] Kailath, T., A view of three decades of linear filter theory, IEEE trans. info. theory, 20, 146-181, (1974) · Zbl 0307.93040
[14] Sauer, T.; Yorke, J.A.; Casdagli, M., Embedology, J. stat. phys., 65, 579-616, (1991) · Zbl 0943.37506
[15] Barron, A.R., Universal approximation bounds for superpositions of a sigmoidal function, IEEE trans. inform. theory, 39, 930-945, (1993) · Zbl 0818.68126
[16] Judd, K.; Mees, A.I., Embedding as a modelling problem, Physica D, 120, 273-286, (1998) · Zbl 0965.37061
[17] H. Akaike, Information theory and an extension of the maximum likelihood principle, in: B.N. Petrov, F. Csaki (Eds.), Second International Symposium on Information Theory, Akademiai Kiado, Budapest, 1976, pp. 267-281.
[18] Hübner, U.; Abraham, N.B.; Weiss, C.O., Dimensions and entropies of chaotic intensity pulsations in a single-mode far-infrared NH_{3} laser, Phys. rev. A, 40, 6354-6365, (1989)
[19] Farmer, J.D.; Sidorowich, J., Predicting chaotic time series, Phys. rev. lett., 59, 845-848, (1987)
[20] W.E. Larimore, R.K. Mehra, The problem of overfitting data, Byte, October 1985, pp. 167-180.
[21] H. Tong, Non-linear Time Series: A Dynamical Systems Approach, Oxford University Press, Oxford, 1990. · Zbl 0716.62085
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.