Dynamic distance-based shape features for gait recognition. (English) Zbl 1312.68204

Summary: We propose a novel skeleton-based approach to gait recognition using our Skeleton Variance Image. The core of our approach consists of employing the screened Poisson equation to construct a family of smooth distance functions associated with a given shape. The screened Poisson distance function approximation nicely absorbs and is relatively stable to shape boundary perturbations which allows us to define a rough shape skeleton. We demonstrate how our Skeleton Variance Image is a powerful gait cycle descriptor leading to a significant improvement over the existing state of the art gait recognition rate.


68T45 Machine vision and scene understanding
68U10 Computing methodologies for image processing


Full Text: DOI


[1] Ambrosio, L., Mantegazza, C.: Curvature and distance function from a manifold. J. Geom. Anal. 8, 723-748 (1998) · Zbl 0941.53009
[2] Ambrosio, L., Tortorelli, V.M.: Approximation of functionals depending on jumps by elliptic functionals via \[\gamma\] γ-convergence. Comm. Pure. Appl. Math. XLIII, 999-1036 (1990) · Zbl 0722.49020
[3] Ardila, D., Mihalas, S., von der Heydt, R., Niebur, E.: Medial axis generation in a model of perceptual organization. In: 46th Annual Conference on Information Sciences and Systems (CISS), pp. 1-4. IEEE, New York (2012)
[4] Aubert, G., Aujol, J.F.: Poisson skeleton revisited: a new mathematical perspective. J. Math. Imaging. Vis. 4, 1-11 (2012) · Zbl 1306.35011
[5] Aubert, G.P.K. (ed).: Mathematical Problems in Image processing. Springer, Heidelberg, (2002) · Zbl 1109.35002
[6] Bashir, K., Xiang, T., Gong, S.: Gait recognition using Gait Entropy Image. In: 3rd International Conference on Crime Detection and Prevention, pp. 1-6. Springer, London (2009) · Zbl 1352.65599
[7] Belyaev, A., Fayolle, P.A., Pasko, A.: Signed \[L_p\] Lp-distance fields. Comput. Aided. Des. 45, 523-528 (2013)
[8] Bhattacharya, T., DiBenedetto, E., Manfredi, J.: Limits as \[p\rightarrow \infty\] p→∞ of \[\Delta_pu_p=f\] Δpup=f and related extremal problems. In: Fascicolo Speciale Nonlinear PDEs, pp. 15-68. Rendiconti del Seminario Matematico Universita e Politecnico di, Torino (1989) · Zbl 0155.16503
[9] Blum, H.; Wathen-Dunn, W. (ed.), Transformation for extracting new descriptors of shape (1967), Cambridge
[10] Bouchrika, I., Nixon, M.: Exploratory factor analysis of gait recognition. In: 8th IEEE International Conference on Automatic Face and Gesture Recognition (2008)
[11] Calakli, F., Taubin, G.: SSD: smooth signed distance surface reconstruction. Comput. Graph. Forum. 30(7), 1993-2002 (2011)
[12] Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern. Anal. Mach. Intell. 8, 679-698 (1986)
[13] Chen, H.S., Chen, H.T., Chen, Y.W., Lee, S.Y.: Human action recognition using star Skeleton. In: Proceedings of the 4th ACM International Workshop on Video Surveillance and Sensor, Networks, pp. 171-178 (2006) · Zbl 0988.65093
[14] Crane, K., Weischedel, C., Wardetzky, M.: Geodesics in heat: a new approach to computing distance based on heat flow. ACM Trans. Graph. 32, 152:1-152:11 (2013)
[15] Cutting, J., Kozlowski, L.: Recognising friends by their walk: Gait perception without familiarity cues. Bull. Psychon. Soc. 9(5), 353-356 (1977)
[16] Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 886-893 (2005) · Zbl 1271.76258
[17] Dempster, W., Gaughran, G.: Properties of body segments based on size and weight. Am. J. Anat. 120(1), 33-54 (1967)
[18] Direkoglu, C., Dahyot, R., Manzke, M.: On using anisotropic diffusion for skeleton extraction. Int. J. Comput. Vis. 100, 170-189 (2012)
[19] Drillis, R., Contini, R.: Body segment parameters. Report No. 1163.03. Office of Vocational Rehabilitation, Department of Health, Education and Welfare, New York (1966) · Zbl 1118.68628
[20] Evans, L.C.: Partial Differenetial Equations. American Mathematical Society, New York (1998)
[21] Freytag, M., Shapiro, V., Tsukanov, I.: Finite element analysis in situ. Finite. Elem. Anal. Des. 47(9), 957-972 (2011)
[22] Giusti, E.: Minimal Surfaces and Functions of Bounded Variation. Monographs in Mathematics, Vol. 80. Birkhäuser, Boston (1984) · Zbl 0545.49018
[23] Gomes, J., Faugeras, O.: The vector distance functions. Int. J. Comput. Vis. 52(2/3), 161-187 (2003) · Zbl 1477.68357
[24] Gorelick, L., Blank, M., Shechtman, E., Irani, M., Basri, R.: Actions as space-time shapes. IEEE Trans. Pattern Anal. Mach. Intell. 29(12), 2247-2253 (2007)
[25] Gorelick, L., Galun, M., Sharon, E., Basri, R., Brandt, A.: Shape representation and classification using the Poisson equation. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 1991-2005 (2006)
[26] Gurumoorthy, K.S., Rangarajan, A.: A Schrödinger equation for the fast computation of approximate Euclidean distance functions. In: Scale Space and Variational Methods in Computer Vision (SSMV 2009). LNCS, vol. 5567, pp. 100-111 Springer (2009) · Zbl 1373.94179
[27] Han, J., Bhanu, B.: Individual recognition using Gait energy image. IEEE Trans. Pattern Anal. Mach. Intell. 28(2), 316-322 (2006)
[28] Hofmann, M., Bachmann, S., Rigoll, G.: 2.5d Gait biometrics using the depth gradient histogram energy image. In: IEEE 5th International Conference on Biometrics: Theory, Applications and Systems (BTAS), pp. 399-403 (2012)
[29] Hofmann, M., Bachmann, S., Rigoll, G.: 2.5D Gait biometrics using the depth gradient histogram energy image. In: 5th IEEE International Conference on Biometrics: Theory, Applications and Systems, pp. 399-403 (2012)
[30] Hofmann, M., Geiger, J., Bachmann, S., Schuller, B., Rigoll, G.: The TUM gait from audio, image and depth (GAID) database: multimodal recognition of subjects and traits. J. Vis. Commun. Image Represent. 117(2), 130-144 (2013) · Zbl 1271.76258
[31] Hofmann, M., Geiger, J., Bachmann, S., Schuller, B., Rigoll, G.: The TUM Gait from Audio, Image and Depth (GAID) Database: Multimodal Recognition of Subjects and Traits. Special Issue on Visual Understanding and Applications with RGB-D Cameras. J. Vis. Commun. Image Represent. (2013)
[32] Hofmann, M., Schmidt, S., Rajagopalan, A., Rigoll, G.: Combined face and Gait recognition using Alpha matte preprocessing. In: IAPR/IEEE International Conference on Biometrics, pp. 390-395 (2012) · Zbl 1352.65599
[33] Huang, X., Boulgouris, N.: Gait recognition with shifted energy image and structural feature extraction. IEEE Trans. Image Process. 21(4), 2256-2268 (2012) · Zbl 1373.94179
[34] Jones, M.W., Baerentzen, J.A., Sramek, M.: 3D distance fields: a survey of techniques and applications. IEEE Trans. Visual. Comput. Graph. 12(4), 581-599 (2006)
[35] Kale, A., Roychowdhury, A., Chellappa, R.: Fusion of gait and face for human identification. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 5, pp. V901-904 (2004)
[36] Karimov, A., Mistelbauer, G., Schmidt, J., Mindek, P., Schmidt, E., Timur Sharipov, T., Bruckner, S., Gröller, M.E.: ViviSection Skeleton-based volume editing. Comput. Graph. Forum. 32(3), 461-470 (2013)
[37] Kawohl, B.: On a family of torsional creep problems. J. Reine Angew. Math. 410(1), 1-22 (1990) · Zbl 0701.35015
[38] Kimia, B.B.: On the role of medial geometry in human vision. J. Physiol. 97(2-3), 155 (2003)
[39] Kovács, I., Fehér, Á., Julesz, B.: Medial-point description of shape: a representation for action coding and its psychophysical correlates. Vis. Res. 38(15), 2323-2333 (1998)
[40] Lam, T., Lee, R., Zhang, D.: Human gait recognition by the fusion of motion and static spatio-temporal templates. Pattern. Recognit. 40(9), 2563-2573 (2007) · Zbl 1118.68628
[41] Lee, L., Grimson, W.: Gait analysis for recognition and classification. In: Proceedings of the 5th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 148-155 (2002) · Zbl 1194.94158
[42] van der Maaten, L.: Matlab toolbox for dimensionality reduction. MIT Press, Cambridge
[43] Mantegazza, C., Mennucci, A.C.: Hamilton-Jacobi equations and distance functions on Riemannian manifolds. Appl. Math. Optim. 47, 1-25 (2003) · Zbl 1048.49021
[44] Martín-Félez, R., Xiang, T.: Gait Recognition by Ranking. Comput. Vis. ECCV, Lect. Notes. Comput. Sci. 7572, 328-341 (2012)
[45] Matovski, D., Nixon, M., Carter, J.: Encyclopedia of Computer vision, chap. Gait recognition. Springer Science+Business Media, Dordrecht (2013, in press)
[46] Matovski, D., Nixon, M., Mahmoodi, S., Carter, J.: The effect of time on Gait recognition performance. IEEE Trans. Inf. Forensics Secur. 7(2), 543-552 (2012)
[47] Mumford, D., Shah, J.: Optimal approximations by piecewise smooth functions and associated variational problems. Commun. Pure and Appl. Math. 42(5), 577-685 (1989) · Zbl 0691.49036
[48] Murray, M., Drought, A., Kory, R.: Walking Patterns of Normal Men. J.Bone. Jt. Surg. 46(2), 335-360 (1964)
[49] Niyogi, S., Adelson, E.: Analyzing gait with spatiotemporal surfaces. In: Proceedings of the IEEE Workshop on Motion of Non-Rigid and Articulated Objects, pp. 64-69. (1994)
[50] Osher, S., Fedkiw, R.P.: Level set methods: an overview and some recent results. J. Comput. Phys. 169, 463-502 (2001) · Zbl 0988.65093
[51] Paragios, N., Taron, M., Huang, X., M., R., Metaxas, D.: On the representation of shapes using implicit functions. In: Statistics and Analysis of Shapes, pp. 167-200. Birkhäuser (2006) · Zbl 1513.62134
[52] Peng, J., Kristjansson, D., Zorin, D.: Interactive modeling of topologically complex geometric detail. ACM Trans. Graph. 23, 635-643 (2004). ACM SIGGRAPH
[53] Petrovic, L., Henne, M.J.A.: Volumetric methods for simulation and rendering of hair. Technical Report, Pixar Animation Studios, Emeryville (2005)
[54] Peyré, G., Cohen, L.D.: Geodesic methods for shape and surface processing. In: Advances in Computational Vision and Medical Image Processing, pp. 29-56. Springer (2009)
[55] Rvachev, V.L.: Theory of R-functions and some applications. Naukova Dumka, Russian (1982) · Zbl 0521.65084
[56] Sethi, M., A., R., Gurumoorthy, K.S.: The Schrödinger distance transform (SDT) for point-sets and curves. In: CVPR, pp. 198-205 (2012)
[57] Shah, J.: Segmentation by nonlinear diffusion. In: CVPR, pp. 202-207 (1991)
[58] Shapiro, V.: Semi-analytic geometry with R-functions. Acta. Numerica. 16, 239-303 (2007) · Zbl 1123.65012
[59] Siddiqi, K., Pizer, S.M.: Medial Representations: Mathematics, Algorithms and Applications, vol. 37. Springer, New York (2008) · Zbl 1151.00014
[60] Sivapalan, S., Chen, D., Denman, S., Sridharan, S., Fookes, C.: Gait energy volumes and frontal gait recognition using depth images. In: International Joint Conference on Biometrics, pp. 1-6. (2011)
[61] Spalding, D.B.: Calculation of turbulent heat transfer in cluttered spaces. In: Proceedings 10th Int. Heat Transfer Conference, Brighton (1994)
[62] Tari, S., Genctav, M.: From a non-local ambrosio-tortorelli phase field to a randomized part hierarchy tree. J. Math. Imaging Vis. 32(2), 161-179 (2013)
[63] Tari, S., Shah, J.: Local symmetries of shapes in arbitrary dimension. In: Sixth International Conference on Computer Vision (ICCV’98), pp. 1123-1128. Bombay, (1998)
[64] Tari, Z.S.G., Shah, J., Pien, H.: Extraction of shape skeletons from grayscale images. Comput. Vis. Image. Underst. 66(2), 133-146 (1997)
[65] Tucker, P.G.: Assessment of geometric multilevel convergence and a wall distance method for flows with multiple internal boundaries. Appl. Math. Model. 22, 293-311 (1998) · Zbl 1428.76141
[66] Tucker, P.G.: Hybrid Hamilton-Jacobi-Poisson wall distance function model. Comput. Fluids. 44(1), 130-142 (2011) · Zbl 1271.76258
[67] Varadhan, S.R.S.: On the behavior of the fundamental solution of the heat equation with variable coefficients. Comm. Pure Appl. Math. 20, 431-455 (1967) · Zbl 0155.16503
[68] Wang, C., Zhang, J., Wang, L., Pu, J., Yuan, X.: Human identification using temporal information preserving Gait template. IEEE Trans. Pattern. Anal. Mach. Intell. 34(11), 2164-2176 (2012)
[69] Wang, L., Ning, H., Tan, T., Hu, W.: Fusion of static and dynamic body biometrics for gait recognition. IEEE Trans. Circuits. Syst. Video. Technol. 14(2), 149-158 (2004)
[70] Xia, H., Tucker, P.G., Coughlin, G.: Novel applications of BEM based Poisson level set approach. Eng. Anal. Bound. Elem. 36, 907-912 (2012) · Zbl 1352.65599
[71] Yogarajah, P., Condell, J., Prasad, G.: PRWGEI: Poisson random walk based gait recognition. In: 7th International Symposium on Image and Signal Processing and Analysis (ISPA), pp. 662-667 (2011)
[72] Yoo, J., Nixon, M.: Automated markerless analysis of human Gait motion for recognition and classification. ETRI J. 33(3), 259-266 (2011)
[73] Yu, S., Tan, D., Tan, T.: A framework for evaluating the effect of view angle, clothing and carrying condition on gait recognition. In: 18th International Conference on Pattern Recognition, ICPR 2006, vol. 4, pp. 441-444 (2006)
[74] Zhang, E., Zhao, Y., Xiong, W.: Active energy image plus 2DLPP for gait recognition. Signal. Process. 90(7), 2295-2302 (2010) · Zbl 1194.94158
[75] Zheng, S., Zhang, J., Huang, J., He, R., Tan, T.: Robust view transformation model for gait recognition. In: 18th IEEE International Conference on Image Processing (ICIP), pp. 2073-2076 (2011)
[76] Zucker, S.W.: Distance images and the enclosure field: applications in intermediate-level computer and biological vision. In: Innovations for Shape Analysis, pp. 301-323. Springer (2013) · Zbl 1314.68325
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.