×

Supervised optimal locality preserving projection. (English) Zbl 1225.68261

Summary: In the past few years, the computer vision and pattern recognition community has witnessed a rapid growth of a new kind of feature extraction method, the manifold learning methods, which attempt to project the original data into a lower dimensional feature space by preserving the local neighborhood structure. Among these methods, locality preserving projection (LPP) is one of the most promising feature extraction techniques. Unlike the unsupervised learning scheme of LPP, this paper follows the supervised learning scheme, i.e., it uses both local information and class information to model the similarity of the data. Based on novel similarity, we propose two feature extraction algorithms, supervised optimal locality preserving projection (SOLPP) and normalized Laplacian-based supervised optimal locality preserving projection (NL-SOLPP). Optimal here means that the extracted features via SOLPP (or NL-SOLPP) are statistically uncorrelated and orthogonal. We compare the proposed SOLPP and NL-SOLPP with LPP, orthogonal locality preserving projection (OLPP) and uncorrelated locality preserving projection (ULPP) on publicly available data sets. Experimental results show that the proposed SOLPP and NL-SOLPP achieve much higher recognition accuracy.

MSC:

68T45 Machine vision and scene understanding
68T10 Pattern recognition, speech recognition

Software:

CMU PIE; FERET; AR face
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Duda, R. O.; Hart, P. E.; Stork, D. G., Pattern Classification (2000), Wiley-Interscience: Wiley-Interscience Hoboken, NJ
[2] Turk, M.; Pentland, A., Eigenfaces for recognition, Journal of Cognitive Neuroscience, 3, 1, 71-86 (1991)
[3] Belhumeur, P. N.; Hespanha, J. P.; Kriegman, D. J., Eigenfaces vs. Fisherfaces: recognition using class specific linear projection, IEEE Transactions on Pattern Analysis and Machine Intelligence, 19, 7, 711-720 (1997)
[4] Roweis, S. T.; Saul, L. K., Nonlinear dimensionality reduction by locally linear embedding, Science, 290, 5500, 2323-2326 (2000)
[5] Tenenbaum, J. B.; de Silva, V.; Langford, J. C., A global geometric framework for nonlinear dimensionality reduction, Science, 290, 5500, 2319-2323 (2000)
[6] He, X.; Yan, S.; Hu, Y.; Niyogi, P.; Zhang, H., Face recognition using Laplacianfaces, IEEE Transactions on Pattern Analysis and Machine Intelligence, 27, 3, 328-340 (2005)
[7] Yan, S.; Xu, D.; Zhang, B.; Zhang, H.; Yang, Q.; Lin, S., Graph embedding and extensions: a general framework for dimensionality reduction, IEEE Transactions on Pattern Analysis and Machine Intelligence, 29, 1, 40-51 (2007)
[8] Kokiopoulou, E.; Saad, Y., Orthogonal neighborhood preserving projections: a projection-based dimensionality reduction technique, IEEE Transactions on Pattern Analysis and Machine Intelligence, 29, 12, 2143-2156 (2007)
[9] Cai, D.; He, X.; Han, J.; Zhang, H.-J., Orthogonal Laplacianfaces for face recognition, IEEE Transactions on Image Processing, 15, 11, 3608-3614 (2006)
[10] Belkin, M.; Niyogi, P., Laplacian eigenmaps for dimensionality reduction and data representation, Neural Computation, 15, 6, 1373-1396 (2003) · Zbl 1085.68119
[11] Zhao, H.; Sun, S.; Jing, Z., Local-information-based uncorrelated feature extraction, Optical Engineering, 45, 020505 (2006)
[12] Yu, W.; Teng, X.; Liu, C., Face recognition using discriminant locality preserving projections, Image and Vision Computing, 24, 239-248 (2006)
[13] D. Cai, X. He, K. Zhou, J. Han, H. Bao, Locality sensitive discriminant analysis, in: Proceedings of the 20th International Joint Conference on Artificial Intelligence, 2007, pp. 708-713.; D. Cai, X. He, K. Zhou, J. Han, H. Bao, Locality sensitive discriminant analysis, in: Proceedings of the 20th International Joint Conference on Artificial Intelligence, 2007, pp. 708-713.
[14] Chen, H. T.; Chang, H. W.; Liu, T. L., Local discriminant embedding and its variants, Proceedings of International Conference on Computer Vision and Pattern Recognition, 2, 846-853 (2005)
[15] Phillips, P. J.; Moon, H.; Rizvi, S. A.; Rauss, P. J., The FERET evaluation methodology for face-recognition algorithms, IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 10, 1090-1104 (2000)
[16] Zheng, Z.; Yang, F.; Tang, W.; Jia, J.; Yang, J., Gabor feature-based face recognition using supervised locality preserving projection, Signal Processing, 87, 2473-2483 (2007) · Zbl 1186.94401
[17] Cheng, J.; Liu, Q.; Lu, H.; Chen, Y., Supervised kernel locality preserving projections for face recognition, Neurocomputing, 67, 443-C449 (2005)
[18] A.M. Martinez, R. Benavente, The AR Face Database, CVC Technical Report 24, June 1998.; A.M. Martinez, R. Benavente, The AR Face Database, CVC Technical Report 24, June 1998.
[19] Sim, T.; Baker, S.; Bsat, M., The CMU pose, illumination, and expression database, IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 12, 1615-1618 (2003)
[20] Luxburg, U., A tutorial on spectral clustering, Statistics and Computing, 17, 395-416 (2007)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.