×

Feature fusion of side face and gait for video-based human identification. (English) Zbl 1132.68671

Summary: Video-based human recognition at a distance remains a challenging problem for the fusion of multimodal biometrics. As compared to the approach based on match score level fusion, in this paper, we present a new approach that utilizes and integrates information from side face and gait at the feature level. The features of face and gait are obtained separately using principal component analysis from enhanced side face image and gait energy image, respectively. Multiple discriminant analysis is employed on the concatenated features of face and gait to obtain discriminating synthetic features. This process allows the generation of better features and reduces the curse of dimensionality. The proposed scheme is tested using two comparative data sets to show the effect of changing clothes and face changing over time. Moreover, the proposed feature level fusion is compared with the match score level fusion and another feature level fusion scheme. The experimental results demonstrate that the synthetic features, encoding both side face and gait information, carry more discriminating power than the individual biometrics features, and the proposed feature level fusion scheme outperforms the match score level and another feature level fusion scheme. The performance of different fusion schemes is also shown as cumulative match characteristic curves. They further demonstrate the strength of the proposed fusion scheme.

MSC:

68T10 Pattern recognition, speech recognition
68U10 Computing methodologies for image processing
PDF BibTeX XML Cite
Full Text: DOI

References:

[1] Ross, A.A.; Nandakumar, K.; Jain, A.K., Handbook of multibiometrics, (2006), Springer Berlin
[2] X. Zhou, B. Bhanu, Feature fusion of face and gait for human recognition at a distance in video, in: Proceedings of the IEEE International Conference on Pattern Recognition, 2006.
[3] G. Feng, K. Dong, D. Hu, D. Zhang, When faces are combined with palmprints: a novel biometric fusion strategy, in: International Conference on Biometric Authentication, 2004, pp. 701-707.
[4] T. Kinnunen, V. Hautamaki, P. Franti, Fusion of spectral feature sets for accurate speaker identification, in: Proceedings of the International Conference on Speech and Computer, September 2004, pp. 361-365.
[5] A. Kumar, D.C.M. Wong, H.C. Shen, A.K. Jain, Personal verification using palmprint and hand geometry biometric, in: Proceedings of the Audio- and Video-based Biometric Person Authentication, 2003, pp. 668-678. · Zbl 1050.68790
[6] A.A. Ross, R. Govindarajan, Feature level fusion of hand and face biometrics, in: Proceedings of the SPIE Conference on Biometric Technology for Human Identification II, March 2005, pp. 196-204.
[7] Yang, J.; Yang, J.Y.; Zhang, D.; Lu, J.F., Feature fusion: parallel strategy vs. serial strategy, Pattern recognition, 38, 6, 1369-1381, (2003) · Zbl 1028.68152
[8] Y.S. Moon, H.W. Yeung, K.C. Chan, S.O. Chan, Template synthesis and image mosaicking for fingerprint registration: an experimental study, in: IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 5, 2004, pp. 409-412.
[9] Y. Gao, M. Maggs, Feature-level fusion in personal identification, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2005.
[10] Kong, A.; Zhang, D.; Kamel, M., Palmprint identification using feature-level fusion, Pattern recognition, 39, 3, 478-487, (2006) · Zbl 1158.68473
[11] Li, Q.; Qiu, Z., Handmetric verification based on feature-level fusion, J. comput. sci. network security, 6, 2A, (2006)
[12] A. Kale, A. Roy-chowdhury, R. Chellappa, Fusion of gait and face for human identification, in: Proceedings of Acoustics, Speech, and Signal Processing, vol. 5, 2004, pp. 901-904.
[13] G. Shakhnarovich, L. Lee, T. Darrell, Integrated face and gait recognition from multiple views, in: Proceedings of Computer Vision and Pattern Recognition, vol. 1, 2001, pp. 439-446.
[14] G. Shakhnarovich, T. Darrell, On probabilistic combination of face and gait cues for identification, in: Proceedings of Automatic Face and Gesture Recognition, vol. 5, 2002, pp. 169-174.
[15] B. Bhanu, X. Zhou, Face recognition from face profile using dynamic time warping, in: Proceedings of the International Conference on Pattern Recognition, vol. 4, 2004, pp. 499-502.
[16] X. Zhou, B. Bhanu, Integrating face and gait for human recognition, in: Proceedings of the Workshop on Biometrics Held in Conjunction with the IEEE Conference on Computer Vision and Pattern Recognition, 2006, pp. 55-62.
[17] X. Zhou, B. Bhanu, Integrating face and gait for human recognition at a distance in video, IEEE Trans. Systems Man Cybernet. Part B: Cybernet, 2007.
[18] Han, J.; Bhanu, B., Individual recognition using gait energy image, IEEE trans. pattern anal. Mach. intell., 28, 2, 316-322, (2006)
[19] X. Zhou, B. Bhanu, J. Han, Human recognition at a distance in video by integrating face profile and gait, in: Proceedings of the Audio- and Video-based Biometric Person Authentication, 2005, pp. 533-543.
[20] Gonzalez, R.C.; Woods, R.E., Digital image processing, (1992), Addison Wesley Publishing Company Reading, MA
[21] Theodorids, S.; Koutroumbas, K., Pattern recognition, (1998), Academic Press New York
[22] Yambor, W.S.; Draper, B.A.; Beveridge, J.R., Analyzing PCA-based face recognition algorithms: eigenvector selection and distance measures, ()
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.