Linear discrimination for three-level multivariate data with a separable additive mean vector and a doubly exchangeable covariance structure. (English) Zbl 1243.62094

Summary: We study a new linear discriminant function for three-level \(m\)-variate observations under the assumption of multivariate normality. We assume that the \(m\)-variate observations have a doubly exchangeable covariance structure consisting of three unstructured covariance matrices for three multivariate levels and a separable additive structure on the mean vector. The new discriminant function is very efficient in discriminating individuals in a small sample scenario. An iterative algorithm is proposed to calculate the maximum likelihood estimates of the unknown population parameters as closed form solutions do not exist for these unknown parameters. The new discriminant function is applied to a real data set as well as to simulated data sets. We compare our findings with other linear discriminant functions for three-level multivariate data as well as with the traditional linear discriminant function.


62H30 Classification and discrimination; cluster analysis (statistical aspects)
62H12 Estimation in multivariate analysis
65C60 Computational problems in statistics (MSC2010)
Full Text: DOI


[1] Akdemir, D., Gupta, A.K., 2011. Array variate random variables with multiway Kronecker delta covariance matrix structure. Tech. Report. Department of Mathematics and Statistics at the Bowling Green State University. · Zbl 1347.62078
[2] Anderson, T.W., An introduction to multivariate statistical analysis, (2003), John Wiley & Sons, Inc. New Jersey · Zbl 1039.62044
[3] Anderson, T.W.; Fang, K.; Hsu, H., Maximum-likelihood estimates and likelihood-ratio criteria for multivariate elliptically contoured distributions, Canadian journal of statistics, 14, 1, 55-59, (1986) · Zbl 0587.62104
[4] Chaudhuri, G.; Borwankar, J.D.; Rao, P.R.K., Bhattacharyya distance based linear discriminant function for stationary time series, Communications in statistics—theory and methods, 20, 2195-2205, (1991) · Zbl 0900.62461
[5] Fang, K.; Anderson, T.W., Statistical inference in elliptically contoured and related distributions, (1990), Allerton Press Inc. New York · Zbl 0747.00016
[6] Gupta, A.K.; Varga, T., Elliptically contoured models in statistics, (1993), Kluwer Academic Publishers Dordrecht, The Netherlands · Zbl 0789.62037
[7] Johnson, R.A.; Wichern, D.W., Applied multivariate statistical analysis, (2007), Pearson Prentice Hall New Jersey · Zbl 1269.62044
[8] Kroonenberg, P.M., Applied multiway data analysis, (2008), John Wiley & Sons, Inc. New Jersey · Zbl 1160.62002
[9] Lange, K.; Wu, T.T., An MM algorithm for multicategory vertex discriminant analysis, Journal of computational and graphical statistics, 17, 527-544, (2008)
[10] Leiva, R., Linear discrimination with equicorrelated training vectors, Journal of multivariate analysis, 98, 2, 384-409, (2007) · Zbl 1112.62057
[11] Leiva, R.A.; Herrera, M., Generalización de la distancia de Mahalanobis para el análisis discriminante lineal en poblaciones con matrices de covarianza desiguales, Revista de la sociedad Argentina de estadística, 3, 64-85, (1999)
[12] Leiva, R.; Roy, A., Classification rules for triply multivariate data with an AR(1) correlation structure on the repeated measures over time, Journal of statistical planning and inference, 139, 8, 2598-2613, (2009) · Zbl 1162.62059
[13] Leiva, R., Roy, A., 2009b. Linear discrimination for three-level multivariate data with structured mean vectors and doubly exchangeable covariance structure, The Paper Presented at the MAT-TRIAD 2009, Bedlewo, Poland, March 23-27.
[14] Leiva, R.; Roy, A., Linear discrimination for multi-level multivariate data with separable means and jointly equicorrelated covariance structure, Journal of statistical planning and inference, 141, 5, 1910-1924, (2011) · Zbl 1207.62137
[15] Lindsey, J.K., Multivariate elliptically contoured distributions for repeated measurements, Biometrics, 55, 1277-1280, (1999) · Zbl 1059.62543
[16] Lindsey, J.K.; Jones, B., Modeling pharmacokinetic data using heavy-tailed multivariate distributions, Journal of biopharmaceutical statistics, 10, 3, 369-381, (2000)
[17] McLachlan, G.J., Discriminant analysis and statistical pattern recognition, (1992), Wiley New York
[18] Paranjpe, S.A.; Gore, A.P., Selecting variables for discrimination when covariance matrices are unequal, Statistics and probability letters, 21, 5, 417-419, (1994) · Zbl 0825.62545
[19] Park, P.S.; Kshirsagar, A.M., Distances between normal populations when covariance matrices are unequal, Communications in statistics—theory and methods, 23, 12, 3549-3556, (1994) · Zbl 0825.62240
[20] Roy, A.; Leiva, R., Discrimination with jointly equicorrelated multi-level multivariate data, Advances in data analysis and classification, 1, 3, 175-199, (2007) · Zbl 1182.62142
[21] Seber, G.A.E., Multivariate observations, (1984), Wiley New York · Zbl 0627.62052
[22] Stanimirova, I.; Simeonov, V., Modeling of environmental four-way data from air quality control, Chemometrics and intelligent laboratory systems, 77, 115-121, (2005)
[23] Wu, T.T.; Lange, K., Multicategory vertex discriminant analysis for high-dimensional data, The annals of applied statistics, 4, 4, 1698-1721, (2010) · Zbl 1220.62086
[24] Yener, B.; Acar, E.; Aguis, P.; Bennett, K., Multiway modeling and analysis in stem cell systems biology, BMC systems biology, 2, (2008)
[25] Ziegler, A., Generalized estimating equations, (2011), Springer New York · Zbl 1291.62018
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.