zbMATH — the first resource for mathematics

Wasserstein distances in the analysis of time series and dynamical systems. (English) Zbl 1214.37054
The concept of transportation distance between attractors in dynamical systems allows one to express how closely the long-term behaviour of two given systems resemble each other. This is a particular example of a Wasserstein distance between probability measures. Wasserstein distances are more robust than other distances and have interesting theoretical features, but, on the other hand, they are more difficult to compute, so that one usually has to resort to various approximations.
In the paper under review, the authors show how these distances can be analyzed statistically to provide useful qualitative and quantitative information about the global structure of dynamical systems. In particular, it is shown that they can be used to classify and discriminate time series, to detect and quantify synchronization phenomena between different dynamical systems and characterize and track bifurcations when the parameters of the system change.
The basic properties of the Wasserstein distances are illustrated by the well-known Hénon map. The methodology developed here is subsequently applied to real problems such as a data set of tidal breathing records to discriminate between patients suffering from asthma and those suffering from chronic obstructive pulmonary disease, as well as time series arising from magneto-encephalografic recordings to detect and quantify functional connectivities.

37M10 Time series analysis of dynamical systems
92C50 Medical applications (general)
Full Text: DOI
[1] Brockwell, P.J.; Davis, R.A., Time series: theory and methods, (1998), Springer · Zbl 0673.62085
[2] Alongi, J.M.; Nelson, G.S., Recurrence and topology, (2007), American Mathematical Society · Zbl 1117.37001
[3] Milnor, J., On the concept of attractor, Comm. math. phys., 99, 177-195, (1985) · Zbl 0595.58028
[4] Ruelle, D., Small random perturbations of dynamical systems and the definition of attractors, Comm. math. phys., 82, 137-151, (1981) · Zbl 0482.58017
[5] Hively, L.M.; Gailey, P.C.; Protopopescu, V.A., Detecting dynamical change in nonlinear time series, Phys. lett. A, 258, 103-114, (1999)
[6] Diks, C.; van Zwet, W.R.; Takens, F.; DeGoede, J., Detecting differences between delay vector distributions, Phys. rev. E, 53, 2169-2176, (1996)
[7] Rapp, P.E.; Albano, A.M.; Schmah, T.I.; Farwell, L.A., Filtered noise can mimic low dimensional chaotic attractors, Phys. rev. E, 47, 2289-2297, (1993)
[8] Moeckel, R.; Murray, B., Measuring the distance between time series, Physica D, 102, 187-194, (1997) · Zbl 0914.62064
[9] Frigyik, B.A.; Srivastava, S.; Gupta, M.R., Functional Bregman divergence and Bayesian estimation of distributions, IEEE trans. inform. theory, 54, 5130-5139, (2008) · Zbl 1319.62137
[10] Ali, M.S.; Silvey, D., A general class of coefficients of divergence of one distribution from another, J. R. stat. soc. ser. B, 28, 131-140, (1966) · Zbl 0203.19902
[11] Villani, C., Topics in optimal transportation, (2003), American Mathematical Society · Zbl 1106.90001
[12] Packard, N.H.; Crutchfield, J.P.; Farmer, J.D.; Shaw, R.S., Geometry from a time series, Phys. rev. lett., 45, 712-716, (1980)
[13] Takens, F., Detecting strange attractors in turbulence, (), 366-381
[14] Stark, J., Observing complexity, seeing simplicity, Philos. trans. R. soc. lond. ser. A, 358, 41-61, (2000) · Zbl 0959.37018
[15] Stark, J.; Broomhead, D.S.; Davies, M.E.; Huke, J., Takens embeddings theorems for forced and stochastic systems, Nonlinear anal., 30, 5303-5314, (1997) · Zbl 0896.93019
[16] Cao, L.; Mees, A.; Judd, K., Dynamics from multivariate time series, Physica D, 121, 75-88, (1998) · Zbl 0933.62083
[17] Fraser, A.M.; Swinney, H.L., Independent coordinates for strange attractors from mutual information, Phys. rev. A, 33, 1134-1140, (1986) · Zbl 1184.37027
[18] Abarbanel, H.D.I.; Brown, R.; Sidorowich, J.J.; Tsimring, L.S., The analysis of observed chaotic data in physical systems, Rev. modern phys., 65, 1331-1392, (1993)
[19] Kantz, H.; Schreiber, T., Nonlinear time series analysis, (2004), Cambridge University Press · Zbl 1050.62093
[20] Lasota, A.; Mackey, M.C., Chaos, fractals and noise—stochastic aspects of dynamics, (1997), Springer
[21] Dellnitz, M.; Junge, O., On the approximation of complicated dynamical behavior, SIAM J. numer. anal., 36, 491-515, (1999) · Zbl 0916.58021
[22] Kantorovich, L.V., On the translocation of masses, C. R. (doklady) acad. sci. URSS, 37, 199-201, (1942) · Zbl 0061.09705
[23] Haker, S.; Zhu, L.; Tannenbaum, A.; Angenent, S., Optimal mass transport for registration and warping, Int. J. comput. vis., 60, 225-240, (2004)
[24] Gangbo, W.; McCann, R., Shape recognition via Wasserstein distance, Quart. appl. math., 4, 705-737, (2000) · Zbl 1039.49038
[25] Frisch, U.; Matarrese, S.; Mohayaee, R.; Sobolevski, A., A reconstruction of the initial conditions of the universe by optimal mass transportation, Nature, 417, 260-262, (2002)
[26] Rubner, Y.; Tomasi, C.; Guibas, L.J., The Earth mover’s distance as a metric for image retrieval, Int. J. comput. vis., 40, 99-121, (2000) · Zbl 1012.68705
[27] Mielke, W.; Berry, K.J., Multiple response permutation methods: A distance based approach, (2001), Springer
[28] Benamou, J.-D.; Brenier, Y.; Guittet, K., The monge – kantorovich mass transfer and its computational fluid mechanics formulation, Internat. J. numer. methods fluids, 40, 21-30, (2002) · Zbl 1058.76586
[29] Bertsekas, D.P., Linear network optimization: algorithms and codes, (1991), The MIT Press · Zbl 0754.90059
[30] Balakrishnan, V.K., Network optimization, (1995), Chapman & Hall · Zbl 0860.90120
[31] Burkard, R.E.; Klinz, B.; Rudolf, R., Perspectives of Monge properties in optimization, Discrete appl. math., 70, 95-161, (1996) · Zbl 0856.90091
[32] Schrijver, A., Theory of linear and integer programming, (1998), John Wiley & Sons · Zbl 0970.90052
[33] A. Löbel, Solving large-scale real-world minimum-cost flow problems by a network simplex method, Tech. Rep., Konrad-Zuse Zentrum für Informationstechnik Berlin, ZIB, 1996. Software available at: http://www.zib.de/Optimization/Software/Mcf/.
[34] Bertsekas, D.P.; Castanon, D.A., The auction algorithm for the transportation problem, Ann. oper. res., 20, 67-96, (1989) · Zbl 0705.90061
[35] Davison, A.C.; Hinkley, D.V., Bootstrap methods and their applications, (1997), Cambridge University Press · Zbl 0886.62001
[36] Borg, I.; Groenen, P.J.F., Modern multidimensional scaling, (2005), Springer
[37] Spence, I.; Domoney, D.W., Single subject incomplete designs for nonmetric multidimensional scaling, Psychometrika, 39, 469-490, (1974) · Zbl 0295.92019
[38] Singer, A., A remark on global positioning from local distances, Proc. natl. acad. sci. USA, 105, 9507-9511, (2008) · Zbl 1205.86043
[39] Laub, J.; Roth, V.; Buhrmann, J.M.; Müller, K.-R., On the information and representation of non-Euclidean pairwise data, Pattern recognit., 39, 1815-1826, (2006) · Zbl 1096.68721
[40] Härdle, W.; Simar, L., Applied multivariate statistical analysis, (2003), Springer · Zbl 1028.62039
[41] Legendre, P.; Legendre, L., Numerical ecology, (1998), Elsevier · Zbl 1033.92036
[42] Small, C.G., The statistical theory of shape, (1996), Springer · Zbl 0859.62087
[43] Critchley, F., On certain linear mappings between inner-product and squared-distance matrices, Linear algebra appl., 105, 91-107, (1988) · Zbl 0644.15003
[44] Young, G.; Householder, A.S., Discussion of a set of points in terms of their mutual distances, Psychometrika, 3, 19-22, (1938) · JFM 64.1302.04
[45] Havel, T.F.; Kuntz, I.D.; Crippen, G.M., The theory and practive of distance geometry, Bull. math. biol., 45, 665-720, (1983) · Zbl 0524.92003
[46] Heiser, W.J.; Meulman, J., Analyzing rectangular tables by joint and constrained multidimensional scaling, J. econometrics, 22, 139-167, (1983)
[47] Shawe-Taylor, J.; Cristianini, N., Kernel methods for pattern analysis, (2004), Cambridge University Press
[48] Maindonald, J.; Braun, J., Data analysis and graphics using R. an example-based approach, (2003), Cambridge University Press · Zbl 1033.62002
[49] Venables, W.N.; Ripley, B.D., Modern applied statistic with S-PLUS, (1999), Springer · Zbl 0927.62002
[50] Næs, T.; Mevik, B., Understanding the collinearity problem in regression and discriminant analysis, J. chemom., 15, 413-426, (2000)
[51] Trosset, M.W.; Priebe, C.E., The out-of-sample problem for classical multidimensional scaling, Comput. statist. data anal., 52, 4635-4642, (2008) · Zbl 05565045
[52] Anderson, M.J.; Robinson, J., Generalized discriminant analysis based on distances, Aust. N. Z. J. stat., 45, 301-318, (2003) · Zbl 1064.62072
[53] Nelder, J.A.; Mead, R., A simplex method for function minimization, Comput. J., 7, 308-313, (1965) · Zbl 0229.65053
[54] Huberty, C.J.; Olejnik, S., Applied manova and discriminant analysis, (2006), John Wiley & Sons · Zbl 1117.62071
[55] Hénon, M., A two-dimensional mapping with a strange attractor, Comm. math. phys., 50, 69-77, (1976) · Zbl 0576.58018
[56] Poon, C.-S.; Barahona, M., Titration of chaos with added noise, Proc. natl. acad. sci. USA, 98, 7107-7112, (2001) · Zbl 0984.37101
[57] Pikovsky, A.; Rosenblum, M.; Kurths, J., Synchronization: A universal concept in nonlinear sciences, (2003), Cambridge University Press · Zbl 1219.37002
[58] Stam, C.J.; van Dijk, B.W., Synchronization likelihood: an unbiased measure of generalized synchronization in multivariate data sets, Physica D, 163, 236-251, (2002) · Zbl 0986.37074
[59] Mackey, M.C.; Milton, J.G., Dynamical diseases, Ann. New York acad. sci., 504, 16-32, (1987)
[60] Glass, L.; Mackey, M.C., From clocks to chaos: the rhythms of life, (1988), Princeton University Press · Zbl 0705.92004
[61] ()
[62] Muskulus, M.; Verduyn-Lunel, S., The analysis of dynamical diseases by optimal transportation distances, ERCIM news, 73, 16-17, (2008)
[63] Oostveen, E.; MacLeod, D.; Lorino, H.; Farré, R., The forced oscillation technique in clinical practice: methodology, recommendations and future developments, Eur. respir. J., 22, 1026-1041, (2003)
[64] Lutchen, K.R.; Sullivan, A.; Arbogast, F.T.; Celli, B.R.; Jackson, A.C., Use of transfer impedance measurements for clinical assessment of lung mechanics, Am. J. respir. crit. care. med., 157, 2, 435-446, (1998)
[65] Slats, A.M.; Janssen, K.; van Schadewijk, A.; van der Plas, D.T., Bronchial inflammation and airway responses to deep inspiration in asthma and chronic obstructive pulmonary disease, Am. J. respir. crit. care. med., 176, 121-128, (2007)
[66] Stephan, K.E.; Riera, J.J.; Deco, G.; Horwitz, B., The brain connectivity workshops: moving the frontiers of computational neuroscience, Neuroimage, 42, 1-9, (2008)
[67] Langheim, F.J.P.; Leuthold, A.C.; Georgopoulos, A.P., Synchronous dynamic brain networks revealed by magnetoencephalography, Proc. natl. acad. sci. USA, 103, 455-459, (2006)
[68] Nolte, G.; Ziehe, A.; Nikulin, V.; Schlögl, A.; Krämer, N.; Brismar, T.; Müller, K.R., Robustly estimating the flow direction of information in complex physical systems, Phys. rev. E, 100, 234101, (2008)
[69] Goodhill, G.J.; Simmen, M.W.; Willshaw, D.J., An evaluation of the use of multidimensional scaling for understanding brain connectivity, Philos. trans. R. soc. lond. ser. B, 348, 265-280, (1995)
[70] Young, M.P.; Scannell, J.W.; O’Neill, M.A.; Hilgetag, C.C.; Burns, G.; Blakemore, C., Non-metric multidimensional scaling in the analysis of neuroanatomical connection data and the organization of the primate cortical visual system, Philos. trans. R. soc. lond. ser. B, 348, 281-308, (1995)
[71] Houweling, S.; Daffertshofer, A.; van Dijk, B.; Beek, P., Neural changes induced by learning a challenging perceptual-motor task, Neuroimage, 41, 1395-1407, (2008)
[72] Muskulus, M.; Verduyn-Lunel, S., Reconstruction of functional brain networks by Wasserstein distances in a listening task, (), 59-61
[73] Muskulus, M.; Houweling, H.; Verduyn-Lunel, S.; Daffertshofer, A., Functional similarities and distance properties, J. neurosci. methods, 183, 31-41, (2009)
[74] Kandel, E.R.; Schwartz, J.H.; Jessell, T.M., Principles of neural science, (2000), Appleton & Lange
[75] Helen, J.L.; Watkins, K.E.; Bishop, D.V.M.; Matthews, P.M., Hemispheric specialization for processing auditory nonspeech stimuli, Cereb. cortex, 16, 1266-1275, (2006)
[76] Muskulus, M.; Scheenstra, A.E.H.; Braakman, N.; Dijkstra, J.; Verduyn-Lunel, S.; Alia, A.; de Groot, H.J.M.; Reiber, J.H.C., Prospects for early detection of alzheimer’s disease from serial MR images in transgenic mouse models, Curr. alzheimer res., 6, 503-518, (2009)
[77] Xu, L.; Krzyzak, A.; Suen, C.Y., Methods of combining multiple classifiers and their applications to handwriting recognition, IEEE trans. syst. man cybern., 22, 418-435, (1992)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.