×
Miettinen, Jari; Taskinen, Sara; Nordhausen, Klaus; Oja, Hannu

Fourth moments and independent component analysis. (English) Zbl 1332.62196

Stat. Sci. 30, No. 3, 372-390 (2015).
Summary: In independent component analysis it is assumed that the components of the observed random vector are linear combinations of latent independent random variables, and the aim is then to find an estimate for a transformation matrix back to these independent components. In the engineering literature, there are several traditional estimation procedures based on the use of fourth moments, such as FOBI (fourth order blind identification), JADE (joint approximate diagonalization of eigenmatrices), and FastICA, but the statistical properties of these estimates are not well known. In this paper various independent component functionals based on the fourth moments are discussed in detail, starting with the corresponding optimization problems, deriving the estimating equations and estimation algorithms, and finding asymptotic statistical properties of the estimates. Comparisons of the asymptotic variances of the estimates in wide independent component models show that in most cases JADE and the symmetric version of FastICA perform better than their competitors.

Cited in 19 Documents

MSC:

62H25 Factor analysis and principal components; correspondence analysis
62H12 Estimation in multivariate analysis
62F12 Asymptotic properties of parametric estimators

Keywords:

affine equivariance; FastICA; FOBI; JADE; kurtosis

Software:

FastICA; JADE
PDF BibTeX XML Cite
\textit{J. Miettinen} et al., Stat. Sci. 30, No. 3, 372--390 (2015; Zbl 1332.62196)
Full Text: DOI arXiv Euclid

References:

[1] Bonhomme, S. and Robin, J.-M. (2009). Consistent noisy independent component analysis. J. Econometrics 149 12-25. · Zbl 1429.62215
[2] Brys, G., Hubert, M. and Struyf, A. (2006). Robust measures of tail weight. Comput. Statist. Data Anal. 50 733-759. · Zbl 1431.62047
[3] Bugrien, J. B. and Kent, J. T. (2005). Independent component analysis: An approach to clustering. In Proceedings in Quantitative Biology , Shape Analysis and Wavelets (S. Barber, P. D. Baxter, K. V. Mardia and R. E. Walls, eds.) 111-114. Leeds Univ. Press, Leeds, UK.
[4] Cardoso, J. F. (1989). Source separation using higher order moments. In Proc. IEEE International Conference on Accoustics , Speech and Signal Processing 2109-2112, Glasgow, UK.
[5] Cardoso, J. F. and Souloumiac, A. (1993). Blind beamforming for non Gaussian signals. IEE Proc. F 140 362-370.
[6] Caussinus, H. and Ruiz-Gazen, A. (1993). Projection pursuit and generalized principal component analyses. In New Directions in Statistical Data Analysis and Robustness ( Ascona , 1992). Monte Verità 35-46. Birkhäuser, Basel. · Zbl 0819.62052
[7] Chen, A. and Bickel, P. J. (2006). Efficient independent component analysis. Ann. Statist. 34 2825-2855. · Zbl 1114.62033
[8] Clarkson, D. B. (1988). A least squares version of algorithm AS 211: The F-G diagonalization algorithm. Appl. Stat. 37 317-321.
[9] Critchley, F., Pires, A. and Amado, C. (2006). Principal axis analysis. Technical Report 06/14, The Open Univ., Milton Keynes, UK.
[10] Darlington, R. B. (1970). Is kurtosis really “peakedness?” Amer. Statist. 24 19-22.
[11] DeCarlo, L. T. (1997). On the meaning and use of kurtosis. Psychol. Methods 2 292-307.
[12] Eriksson, J. and Koivunen, V. (2004). Identifiability, separability and uniqueness of linear ICA models. IEEE Signal Process. Lett. 11 601-604.
[13] Friedman, J. H. and Tukey, J. W. (1974). A projection pursuit algorithm for exploratory data analysis. IEEE Trans. Comput. C 23 881-890. · Zbl 0284.68079
[14] Hallin, M. and Mehta, C. (2015). \(R\)-estimation for asymmetric independent component analysis. J. Amer. Statist. Assoc. 110 218-232. · Zbl 1381.62145
[15] Huber, P. J. (1981). Robust Statistics . Wiley, New York. · Zbl 0536.62025
[16] Huber, P. J. (1985). Projection pursuit. Ann. Statist. 13 435-525. · Zbl 0595.62059
[17] Hyvärinen, A. (1999). Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Netw. 10 626-634.
[18] Hyvärinen, A., Karhunen, J. and Oja, E. (2001). Independent Component Analysis . Wiley, New York.
[19] Hyvärinen, A. and Oja, E. (1997). A fast fixed-point algorithm for independent component analysis. Neural Comput. 9 1483-1492.
[20] Ilmonen, P., Nevalainen, J. and Oja, H. (2010). Characteristics of multivariate distributions and the invariant coordinate system. Statist. Probab. Lett. 80 1844-1853. · Zbl 1202.62068
[21] Ilmonen, P. and Paindaveine, D. (2011). Semiparametrically efficient inference based on signed ranks in symmetric independent component models. Ann. Statist. 39 2448-2476. · Zbl 1231.62043
[22] Jones, M. C. and Sibson, R. (1987). What is projection pursuit? J. Roy. Statist. Soc. Ser. A 150 1-36. · Zbl 0632.62059
[23] Kankainen, A., Taskinen, S. and Oja, H. (2007). Tests of multinormality based on location vectors and scatter matrices. Stat. Methods Appl. 16 357-379. · Zbl 1405.62062
[24] Karvanen, J. and Koivunen, V. (2002). Blind separation methods based on pearson system and its extensions. Signal Process. 82 663-673. · Zbl 0998.94002
[25] Koldovský, Z., Tichavský, P. and Oja, E. (2006). Efficient variant of algorithm FastICA for independent component analysis attaining the Cramér-Rao lower bound. IEEE Trans. Neural Netw. 17 1265-1277.
[26] Kollo, T. (2008). Multivariate skewness and kurtosis measures with an application in ICA. J. Multivariate Anal. 99 2328-2338. · Zbl 1294.62021
[27] Kollo, T. and Srivastava, M. S. (2004). Estimation and testing of parameters in multivariate Laplace distribution. Comm. Statist. Theory Methods 33 2363-2387. · Zbl 1217.62080
[28] Mardia, K. V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika 57 519-530. · Zbl 0214.46302
[29] Maronna, R. A. (1976). Robust \(M\)-estimators of multivariate location and scatter. Ann. Statist. 4 51-67. · Zbl 0322.62054
[30] Miettinen, J., Nordhausen, K., Oja, H. and Taskinen, S. (2013). Fast equivariant JADE. In Proc. 38 th IEEE International Conference on Acoustics , Speech , and Signal Processing ( ICASSP 2013) 6153-6157. Vancouver, BC.
[31] Miettinen, J., Nordhausen, K., Oja, H. and Taskinen, S. (2014a). Deflation-based FastICA with adaptive choices of nonlinearities. IEEE Trans. Signal Process. 62 5716-5724. · Zbl 1394.94394
[32] Miettinen, J., Illner, K., Nordhausen, K., Oja, H., Taskinen, S. and Theis, F. J. (2014b). Separation of uncorrelated stationary time series using autocovariance matrices. Available at . arXiv:1405.3388 · Zbl 1381.62250
[33] Móri, T. F., Rohatgi, V. K. and Székely, G. J. (1993). On multivariate skewness and kurtosis. Theory Probab. Appl. 38 547-551. · Zbl 0807.60020
[34] Nordhausen, K., Oja, H. and Ollila, E. (2011). Multivariate models and the first four moments. In Nonparametric Statistics and Mixture Models 267-287. World Scientific, Singapore.
[35] Nordhausen, K., Ilmonen, P., Mandal, A., Oja, H. and Ollila, E. (2011). Deflation-based FastICA reloaded. In Proc. 19 th European Signal Processing Conference 2011 ( EUSIPCO 2011) 1854-1858. World Scientific, Singapore.
[36] Oja, H. (1981). On location, scale, skewness and kurtosis of univariate distributions. Scand. J. Stat. 8 154-168. · Zbl 0525.62020
[37] Oja, H., Sirkiä, S. and Eriksson, J. (2006). Scatter matrices and independent component analysis. Aust. J. Stat. 35 175-189.
[38] Ollila, E. (2010). The deflation-based FastICA estimator: Statistical analysis revisited. IEEE Trans. Signal Process. 58 1527-1541. · Zbl 1392.94370
[39] Pearson, K. (1895). Contributions to the mathematical theory of evolution, II: Skew variation in homogeneous material. Philos. Trans. R. Soc. 186 343-414.
[40] Pearson, K. (1905). Das Fehlergesetz und seine Verallgemeinerungen durch Fechner und Pearson. A Rejoinder. Biometrika 4 169-212. · JFM 36.0313.10
[41] Peña, D. and Prieto, F. J. (2001). Cluster identification using projections. J. Amer. Statist. Assoc. 96 1433-1445. · Zbl 1051.62055
[42] Peña, D., Prieto, F. J. and Viladomat, J. (2010). Eigenvectors of a kurtosis matrix as interesting directions to reveal cluster structure. J. Multivariate Anal. 101 1995-2007. · Zbl 1203.62114
[43] Samworth, R. J. and Yuan, M. (2012). Independent component analysis via nonparametric maximum likelihood estimation. Ann. Statist. 40 2973-3002. · Zbl 1296.62084
[44] Serfling, R. J. (1980). Approximation Theorems of Mathematical Statistics . Wiley, New York. · Zbl 0538.62002
[45] Tichavsky, P., Koldovsky, Z. and Oja, E. (2006). Performance analysis of the FastICA algorithm and Cramer-Rao bounds for linear independent component analysis. IEEE Trans. Signal Process. 54 1189-1203. · Zbl 1373.94712
[46] Tyler, D. E., Critchley, F., Dümbgen, L. and Oja, H. (2009). Invariant co-ordinate selection. J. R. Stat. Soc. Ser. B Stat. Methodol. 71 549-592. · Zbl 1250.62032
[47] Van Zwet, W. R. (1964). Convex Transformations of Random Variables. Mathematical Centre Tracts 7 . Mathematical Centre, Amsterdam. · Zbl 0125.37102
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.