Image coding based on maximum entropy partitioning for identifying improbable intensities related to facial expressions. (English) Zbl 1365.94165

Summary: In this paper we investigate information-theoretic image coding techniques that assign longer codes to improbable, imprecise and non-distinct intensities in the image. The variable length coding techniques when applied to cropped facial images of subjects with different facial expressions, highlight the set of low probability intensities that characterize the facial expression such as the creases in the forehead, the widening of the eyes and the opening and closing of the mouth. A new coding scheme based on maximum entropy partitioning is proposed in our work, particularly to identify the improbable intensities related to different emotions. The improbable intensities when used as a mask decode the facial expression correctly, providing an effective platform for future emotion categorization experiments.


94A17 Measures of information, entropy
94A29 Source coding
94A08 Image processing (compression, reconstruction, etc.) in information and communication theory
Full Text: DOI Link


[1] De la Torre Fernando and Jeffrey F Cohn 2011 Facial expression analysis. In: Visual analysis of humans, pp. 377-409. Springer London
[2] Kanade T, Cohn J F and Tian Y 2000 Comprehensive database for facial expression analysis. In: Proceedings of International Conference on Automatic Face and Gesture Recognition, pp. 46-53
[3] Zwakhalen Sandra, MG; Hamers, Jan P H; Abu-Saad, Huda H; Berger, Martijn P F, Pain in elderly people with severe dementia: A systematic review of behavioural pain assessment tools, BMC Geriatr., 6, 3, (2006)
[4] Izard Carroll, E; etal., Changes in facial expressions of 2-to 19-month-old infants following acute pain, Dev. Psychol., 19, 418, (1983)
[5] Edwards, Jane; Jackson, Henry J; Pattison, Philippa E, Emotion recognition via facial expression and affective prosody in schizophrenia: a methodological review, Clin. Psychol. Rev., 22, 789-832, (2002)
[6] Prkachin Kenneth, M, The consistency of facial expressions of pain: a comparison across modalities, Pain, 51, 297-306, (1992)
[7] Schwartz Gary, E; Fair, Paul L; Salt, Patricia; Mandel, Michel R; Klerman, Gerald L, Facial expression and imagery in depression: an electromyographic study, Psychosomatic Med., 38, 337-347, (1976)
[8] Picard Rosalind W 2000 Toward computers that recognize and respond to user emotion. IBM Syst. J. 39(3.4): 705-719
[9] Bartlett Marian Stewart, Gwen Littlewort, Ian Fasel and Javier R Movellan 2003 Real time face detection and facial expression recognition: development and applications to human computer interaction. In: CVPRW’03, Conference on Comput.er Vision and Pattern Recognition Workshop 2003, vol. 5, pp. 53-53
[10] Fong, Terrence; Nourbakhsh, Illah; Dautenhahn, Kerstin, A survey of socially interactive robots, Robotics and autonomous systems, 42, 143-166, (2003) · Zbl 1011.68796
[11] Scheirer Jocelyn, Raul Fernandez and Rosalind W Picard 1999 Expression glasses: a wearable device for facial expression recognition. In: CHI’99 Extended Abstracts on Human Factors in Computing Systems, pp. 262-263. ACM
[12] Lyons Michael J and Nobuji Tetsutani 2001 Facing the music: a facial action controlled musical interface. In: CHI’01 extended abstracts on Human factors in computing systems, pp. 309-310. ACM
[13] Den Uyl M J and Van Kuilenburg H 2005 The FaceReader: online facial expression recognition. In: Proceedings of Measuring Behavior, vol. 30
[14] Oliver, Nuria; Pentland, Alex; Bérard, François, LAFTER: a real-time face and lips tracker with facial expression recognition, Pattern Recognit., 33, 1369-1382, (2000)
[15] Boucher, Jerry D; Carlson, Gary E, Recognition of facial expression in three cultures, J. Cross-Cultural Psychol., 11, 263-280, (1980)
[16] Tranel, Daniel; Damasio, Antonio R; Damasio, Hanna, Intact recognition of facial expression, gender, and age in patients with impaired recognition of face identity, Neurology, 38, 690, (1988)
[17] Cohen, Ira; Sebe, Nicu; Garg, Ashutosh; Chen, Lawrence S; Huang, Thomas S, Facial expression recognition from video sequences: temporal and static modeling, Comput. Vis. Image Understand., 91, 160-187, (2003)
[18] Hills, Peter J; Pake, J Michael, Eye-tracking the own-race bias in face recognition: revealing the perceptual and socio-cognitive mechanisms, Cognition, 129, 586-597, (2013)
[19] Lienhart Rainer and Jochen Maydt 2002 An extended set of haar-like features for rapid object detection. In: Proceedings of International Conference on Image Processing. 2002. vol. 1. IEEE
[20] Magalhães Filipe et al 2013 Compressive sensing based face detection without explicit image reconstruction using support vector machines. Image analysis and recognition. Springer Berlin Heidelberg, pp. 758-765
[21] Reisfeld Daniel and Yehezkel Yeshurun 1992 Robust detection of facial features by generalized symmetry. In: International Conference on Pattern Recognition, pp. 117-117. IEEE Computer Society Press
[22] Roth, Dan; Yang, Ming-Hsuan; Ahuja, Narendra, No article title, A SNoW-based face detector. Urbana, 51, 61801, (2000)
[23] Susan Seba and Pooja Kadyan 2013 A supervised fuzzy eye pair detection algorithm. In: 5th International Conference on Computational Intelligence and Communication Networks (CICN), 2013, pp. 306-310. IEEE
[24] Zhang Lun et al 2007 Face detection based on multi-block lbp representation. Advances in biometrics. Springer Berlin Heidelberg, pp. 11-18
[25] Viola, Paul; Jones, Michael J, Robust real-time face detection, Int. J. Comput. Vis., 57, 137-154, (2004)
[26] Ojala, T; Pietikaenen, M; Maenepae, T, Multi-resolution gray scale and rotation invariant texture classification with LBP, IEEE Trans. Pattern Anal. Mach. Intell., 24, 971-987, (2002)
[27] Zhao, G; Pietikäinen, Matti, Dynamic texture recognition using local binary patterns with application to facial expressions, IEEE Trans. Pattern Anal. Mach. Intell., 29, 915-928, (2007)
[28] Hernández, Benjamín; Olague, Gustavo; Hammoud, Riad; Trujillo, Leonardo; Romero, Eva, Visual learning of texture descriptors for facial expression recognition in thermal imagery, Comput. Vis. Image Understand., 106, 258-269, (2007)
[29] Liao, Shu; Fan, Wei; Chung, Albert CS; Yeung, Dit-Yan, Facial expression recognition using advanced local binary patterns, Tsallis entropies and global appearance features, IEEE International Conference on Image Processing, 2006, 665-668, (2006)
[30] Lyons, Michael; Akamatsu, Shigeru; Kamachi, Miyuki; Gyoba, Jiro, Coding facial expressions with Gabor wavelets, Proceedings of Third IEEE International Conference on Automatic Face and Gesture Recognition, 1998, 200-205, (1998)
[31] Manjunath, Bangalore S; Ma, Wei-Ying, Texture features for browsing and retrieval of image data, IEEE Trans. Pattern Anal. Mach. Intell., 18, 837-842, (1996)
[32] Seba Susan and Gitin Kakkar 2015 Decoding facial expressions using a new normalized similarity index. In2015 Annual IEEE India Conference (INDICON), pp. 1-6. IEEE
[33] Milborrow, Stephen; Nicolls, Fred, Locating facial features with an extended active shape model, 504-513, (2008), Berlin Heidelberg
[34] Huffman, David A, A method for the construction of minimum redundancy codes, Proc. IRE, 40, 1098-1101, (1952) · Zbl 0137.13605
[35] Fano Robert, M; Wintringham, WT, Transmission of information, Phys. Today, 14, 56, (1961)
[36] Shannon, CE, A mathematical theory of communication, Bell Syst. Tech. J., 27, 379-423, (1948) · Zbl 1154.94303
[37] Chanda Bhabatosh and Dwijesh Dutta Majumder 2004 Digital image processing and analysis. PHI Learning Pvt. Ltd
[38] Jeon Byeung-woo, Jechang Jeong and Ju-ha Park 1996 Apparatus for variable-length coding and variable-length-decoding using a plurality of Huffman coding tables. U.S. Patent 5,528,628, issued June 18
[39] Yasuhiro, Takishima; Wada, Masahiro; Murakami, Hitomi, Reversible variable length codes, IEEE Trans. Commun., 43, 158-162, (1995) · Zbl 0980.94511
[40] Zhou, Jiantao; Liang, Zhiqin; Chen, Yan; Au, Oscar C, Security analysis of multimedia encryption schemes based on multiple Huffman table, Signal Process. Lett. IEEE, 14, 201-204, (2007)
[41] Nag, Amitava; Biswas, Sushanta; Sarkar, Debasree; Sarkar, Partha Pratim, A novel technique for image steganography based on DWT and Huffman encoding, Int. J. Comput. Sci. Security, 4, 497-610, (2011)
[42] Al-Laham, Mohammed; Emary, Ibrahiem MM, Comparative study between various algorithms of data compression techniques, Int. J. Comput. Sci. Netw. Security, 7, 281, (2007)
[43] Christiansen Mark M et al 2013 Brute force searching, the typical set and Guesswork. IEEE International Symposium on Information Theory Proceedings (ISIT), 2013
[44] Huang, Xiaohua; Zhao, Guoying; Hong, Xiaopeng; Zheng, Wenming; Pietikäinen, Matti, Spontaneous facial micro-expression analysis using spatiotemporal completed local quantized patterns, Neurocomputing., 175, 564-578, (2016)
[45] Seba Susan and Roni Chakre 2016 3D-difference theoretic texture features for dynamic face recognition. In2016 International conference on computational techniques in information and communication technologies (ICCTICT), pp. 227-232. IEEE · Zbl 0137.13605
[46] Pal Nikhil, R; Pal, Sankar K, Entropic thresholding, Signal Process., 16, 97-108, (1989)
[47] Susan, Seba; Hanmandlu, Madasu, A non-extensive entropy feature and its application to texture classification, Neurocomputing, 120, 214-225, (2013)
[48] Susan, Seba; Hanmandlu, Madasu, Unsupervised detection of nonlinearity in motion using weighted average of non-extensive entropies, SIViP, 9, 511-525, (2015)
[49] Susan S and Dwivedi M 2014 Dynamic growth of hidden-layer neurons using the non-extensive entropy. In2014 Fourth international conference on communication systems and network technologies (CSNT), 7 Apr 2014, pp. 491-495. IEEE
[50] Seba Susan and Ankit Kumar 2016 Auto-segmentation using mean-shift and entropy analysis. In:2016 3rd International conference on computing for sustainable global development (INDIACom), pp. 292-296. IEEE
[51] Susan, Seba; Hanmandlu, Madasu, Difference tinvariant texture classification, IET Image Process., 7, 725-732, (2013)
[52] Bezdek J C 1981 Pattern recognition with fuzzy objective function algorithms. New York: Plenum Press · Zbl 0503.68069
[53] Raheja Jagdish Lal, Radhey Shyam, Jatin Gupta, Umesh Kumar and Bhanu Prasad P 2010 Facial gesture identification using lip contours. In: Second International Conference on Machine Learning and Computing (ICMLC), 2010, pp. 3-7. IEEE · Zbl 1011.68796
[54] Avci, Engin, An expert system based on wavelet neural network adaptive norm entropy for scale invariant texture classification, Expert Syst. Appl., 32, 919-926, (2007)
[55] Filko, Damir; Martinovic, Goran, Emotion recognition system by a neural network based facial expression analysis, Automatika-J. Control Meas. Electron. Comput. Commun., 54, 263-272, (2013)
[56] Shan, Caifeng; Gong, Shaogang; McOwan, Peter W, Facial expression recognition based on local binary patterns: A comprehensive study, Image Vis. Comput., 27, 803-816, (2009)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.