# zbMATH — the first resource for mathematics

Convergence of eigenvector empirical spectral distribution of sample covariance matrices. (English) Zbl 1447.15033
Summary: The eigenvector empirical spectral distribution (VESD) is a useful tool in studying the limiting behavior of eigenvalues and eigenvectors of covariance matrices. In this paper, we study the convergence rate of the VESD of sample covariance matrices to the deformed Marčenko-Pastur (MP) distribution. Consider sample covariance matrices of the form $$\Sigma^{1/2}XX^*\Sigma^{1/2}$$, where $$X=(x_{ij})$$ is an $$M\times N$$ random matrix whose entries are independent random variables with mean zero and variance $$N^{-1}$$, and $$\Sigma$$ is a deterministic positive-definite matrix. We prove that the Kolmogorov distance between the expected VESD and the deformed MP distribution is bounded by $$N^{-1+\epsilon }$$ for any fixed $$\epsilon >0$$, provided that the entries $$\sqrt{N}x_{ij}$$ have uniformly bounded 6th moments and $$|N/M-1|\ge \tau$$ for some constant $$\tau >0$$. This result improves the previous one obtained in [N. Xia et al., Ann. Stat. 41, No. 5, 2572–2607 (2013; Zbl 1285.15018)], which gave the convergence rate $$O(N^{-1/2})$$ assuming i.i.d. $$X$$ entries, bounded 10th moment, $$\Sigma =I$$ and $$M< N$$. Moreover, we also prove that under the finite $$8$$ th moment assumption, the convergence rate of the VESD is $$O(N^{-1/2+\epsilon })$$ almost surely for any fixed $$\epsilon >0$$, which improves the previous bound $$N^{-1/4+\epsilon }$$ in [N. Xia et al., Ann. Stat. 41, No. 5, 2572–2607 (2013; Zbl 1285.15018)].
##### MSC:
 15B52 Random matrices (algebraic aspects) 60B20 Random matrices (probabilistic aspects) 62E20 Asymptotic distribution theory in statistics
Full Text:
##### References:
  Anderson, T. W. (1963). Asymptotic theory for principal component analysis. Ann. Math. Stat. 34 122-148. · Zbl 0202.49504  Bai, Z. and Silverstein, J. W. (2006). Spectral Analysis of Large Dimensional Random Matrices, Mathematics Monograph Series 2. Science Press, Beijing. · Zbl 1196.60002  Bai, Z. D. (1993). Convergence rate of expected spectral distributions of large random matrices. II. Sample covariance matrices. Ann. Probab. 21 649-672. · Zbl 0779.60025  Bai, Z. D., Miao, B. Q. and Pan, G. M. (2007). On asymptotics of eigenvectors of large sample covariance matrix. Ann. Probab. 35 1532-1572. · Zbl 1162.15012  Bai, Z. D. and Silverstein, J. W. (1998). No eigenvalues outside the support of the limiting spectral distribution of large-dimensional sample covariance matrices. Ann. Probab. 26 316-345. · Zbl 0937.60017  Bao, Z., Pan, G. and Zhou, W. (2015). Universality for the largest eigenvalue of sample covariance matrices with general population. Ann. Statist. 43 382-421. · Zbl 1408.60006  Bao, Z. G., Pan, G. M. and Zhou, W. (2013). Local density of the spectrum on the edge for sample covariance matrices with general population. Preprint.  Bianchi, P., Debbah, M., Maida, M. and Najim, J. (2011). Performance of statistical tests for single-source detection using random matrix theory. IEEE Trans. Inform. Theory 57 2400-2419. · Zbl 1366.94140  Bloemendal, A., Erdős, L., Knowles, A., Yau, H.-T. and Yin, J. (2014). Isotropic local laws for sample covariance and generalized Wigner matrices. Electron. J. Probab. 19 no. 33, 53. · Zbl 1288.15044  Bun, J., Allez, R., Bouchaud, J.-P. and Potters, M. (2016). Rotational invariant estimator for general noisy matrices. IEEE Trans. Inform. Theory 62 7475-7490. · Zbl 1359.94066  Cai, T. T., Ma, Z. and Wu, Y. (2013). Sparse PCA: Optimal rates and adaptive estimation. Ann. Statist. 41 3074-3110. · Zbl 1288.62099  Davies, E. B. (1995). The functional calculus. J. Lond. Math. Soc. (2) 52 166-176. · Zbl 0858.47012  Dieng, M. and Tracy, C. A. (2011). Application of random matrix theory to multivariate statistics. In Random Matrices, Random Processes and Integrable Systems. CRM Ser. Math. Phys. 443-507. Springer, New York. · Zbl 06073565  Ding, X. and Yang, F. (2018). A necessary and sufficient condition for edge universality at the largest singular values of covariance matrices. Ann. Appl. Probab. 28 1679-1738. · Zbl 1426.15052  El Karoui, N. (2007). Tracy-Widom limit for the largest eigenvalue of a large class of complex sample covariance matrices. Ann. Probab. 35 663-714. · Zbl 1117.60020  El Karoui, N. (2009). Concentration of measure and spectra of random matrices: Applications to correlation matrices, elliptical distributions and beyond. Ann. Appl. Probab. 19 2362-2405. · Zbl 1255.62156  Erdős, L., Knowles, A. and Yau, H.-T. (2013). Averaging fluctuations in resolvents of random band matrices. Ann. Henri Poincaré 14 1837-1926. · Zbl 1296.15020  Erdős, L., Yau, H.-T. and Yin, J. (2011). Universality for generalized Wigner matrices with Bernoulli distribution. J. Comb. 2 15-81. · Zbl 1235.15029  Fama, E. and French, K. (1992). The cross-section of expected stock returns. J. Finance 47 427-465.  Fan, J., Fan, Y. and Lv, J. (2008). High dimensional covariance matrix estimation using a factor model. J. Econometrics 147 186-197. · Zbl 1429.62185  Fan, J., Liao, Y. and Liu, H. (2016). An overview of the estimation of large covariance and precision matrices. Econom. J. 19 C1-C32.  Götze, F. and Tikhomirov, A. (2004). Rate of convergence in probability to the Marchenko-Pastur law. Bernoulli 10 503-548. · Zbl 1049.60018  Hachem, W., Hardy, A. and Najim, J. (2016). Large complex correlated Wishart matrices: Fluctuations and asymptotic independence at the edges. Ann. Probab. 44 2264-2348. · Zbl 1346.15035  Johnson, R. A. and Wichern, D. W. (2007). Applied Multivariate Statistical Analysis, 6th ed. Pearson Prentice Hall, Upper Saddle River, NJ. · Zbl 1269.62044  Johnstone, I. M. (2001). On the distribution of the largest eigenvalue in principal components analysis. Ann. Statist. 29 295-327. · Zbl 1016.62078  Johnstone, I. M. (2007). High dimensional statistical inference and random matrices. In International Congress of Mathematicians. Vol. I 307-333. Eur. Math. Soc., Zürich. · Zbl 1120.62033  Johnstone, I. M. (2008). Multivariate analysis and Jacobi ensembles: Largest eigenvalue, Tracy-Widom limits and rates of convergence. Ann. Statist. 36 2638-2716. · Zbl 1284.62320  Kay, S. M. (1998). Fundamentals of Statistical Signal Processing, Volume 2: Detection Theory. Prentice Hall, New York.  Knowles, A. and Yin, J. (2013). The isotropic semicircle law and deformation of Wigner matrices. Comm. Pure Appl. Math. 66 1663-1750. · Zbl 1290.60004  Knowles, A. and Yin, J. (2017). Anisotropic local laws for random matrices. Probab. Theory Related Fields 169 257-352. · Zbl 1382.15051  Ledoit, O. and Péché, S. (2011). Eigenvectors of some large sample covariance matrix ensembles. Probab. Theory Related Fields 151 233-264. · Zbl 1229.60009  Lee, J. O. and Schnelli, K. (2016). Tracy-Widom distribution for the largest eigenvalue of real sample covariance matrices with general population. Ann. Appl. Probab. 26 3786-3839. · Zbl 1384.60026  Lee, J. O. and Yin, J. (2014). A necessary and sufficient condition for edge universality of Wigner matrices. Duke Math. J. 163 117-173. · Zbl 1296.60007  Ma, Z. (2013). Sparse principal component analysis and iterative thresholding. Ann. Statist. 41 772-801. · Zbl 1267.62074  Marčenko, V. A. and Pastur, L. A. (1967). Distribution of eigenvalues for some sets of random matrices. Math. USSR, Sb. 1 457.  Nadakuditi, R. R. and Edelman, A. (2008). Sample eigenvalue based detection of high-dimensional signals in white noise using relatively few samples. IEEE Trans. Signal Process. 56 2625-2638. · Zbl 1390.94567  Nadakuditi, R. R. and Silverstein, J. W. (2010). Fundamental limit of sample generalized eigenvalue based detection of signals in noise using relatively few signal-bearing and noise-only samples. IEEE J. Sel. Top. Signal Process. 4 468-480.  Onatski, A. (2008). The Tracy-Widom limit for the largest eigenvalues of singular complex Wishart matrices. Ann. Appl. Probab. 18 470-490. · Zbl 1141.60009  Onatski, A. (2009). Testing hypotheses about the numbers of factors in large factor models. Econometrica 77 1447-1479. · Zbl 1182.62180  Patterson, N., Price, A. L. and Reich, D. (2006). Population structure and eigenanalysis. PLoS Genet. 2 1-20.  Paul, D. (2007). Asymptotics of sample eigenstructure for a large dimensional spiked covariance model. Statist. Sinica 17 1617-1642. · Zbl 1134.62029  Paul, D. and Silverstein, J. W. (2009). No eigenvalues outside the support of the limiting empirical spectral distribution of a separable covariance matrix. J. Multivariate Anal. 100 37-57. · Zbl 1154.60320  Pillai, N. S. and Yin, J. (2014). Universality of covariance matrices. Ann. Appl. Probab. 24 935-1001. · Zbl 1296.15021  Silverstein, J. W. (1989). On the eigenvectors of large-dimensional sample covariance matrices. J. Multivariate Anal. 30 1-16. · Zbl 0678.60011  Silverstein, J. W. (1990). Weak convergence of random functions defined by the eigenvectors of sample covariance matrices. Ann. Probab. 18 1174-1194. · Zbl 0708.62051  Silverstein, J. W. and Bai, Z. D. (1995). On the empirical distribution of eigenvalues of a class of large-dimensional random matrices. J. Multivariate Anal. 54 175-192. · Zbl 0833.60038  Silverstein, J. W. and Choi, S.-I. (1995). Analysis of the limiting spectral distribution of large-dimensional random matrices. J. Multivariate Anal. 54 295-309. · Zbl 0872.60013  Wang, L. and Paul, D. (2014). Limiting spectral distribution of renormalized separable sample covariance matrices when $$p/n\to 0$$. J. Multivariate Anal. 126 25-52. · Zbl 1286.60009  Xi, H., Yang, F. and Yin, J. (2017). Local circular law for the product of a deterministic matrix with a random matrix. Electron. J. Probab. 22 Paper No. 60, 77. · Zbl 1373.15058  Xi, H., Yang, F. and Yin, J. (2019). Supplement to “Convergence of eigenvector empirical spectral distribution of sample covariance matrices.” https://doi.org/10.1214/19-AOS1832SUPP.  Xia, N. and Bai, Z. (2019). Convergence rate of eigenvector empirical spectral distribution of large Wigner matrices. Statist. Papers 60 633-665. · Zbl 1420.62235  Xia, N., Qin, Y. and Bai, Z. (2013). Convergence rates of eigenvector empirical spectral distribution of large dimensional sample covariance matrix. Ann. Statist. 41 2572-2607. · Zbl 1285.15018  Yang, F. · Zbl 1436.15042
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.