Facial expression recognition based on discrete separable shearlet transform and feature selection.

*(English)*Zbl 07052210Summary: In this paper, a novel approach to facial expression recognition based on the discrete separable shearlet transform (DSST) and normalized mutual information feature selection is proposed. The approach can be divided into five steps. First, all test and training images are preprocessed. Second, DSST is applied to the preprocessed facial expression images, and all the transformation coefficients are obtained as the original feature set. Third, an improved normalized mutual information feature selection is proposed to find the optimal feature subset of the original feature set, thus we can retain the key classification information of the original data. Fourth, the feature extraction and selection of the feature space is reduced by employing linear discriminant analysis. Finally, a support vector machine is used to recognize the expressions. In this study, experimental verification was carried out on four open facial expression databases. The results show that this method can not only improve the recognition rate of facial expressions, but also significantly reduce the computational complexity and improve the system efficiency.

##### MSC:

94A08 | Image processing (compression, reconstruction, etc.) in information and communication theory |

62H30 | Classification and discrimination; cluster analysis (statistical aspects) |

62H35 | Image analysis in multivariate analysis |

##### Keywords:

facial expression recognition; discrete separable shearlet transform; feature selection; linear discriminant analysis; support vector machine
PDF
BibTeX
XML
Cite

\textit{Y. Lu} et al., Algorithms (Basel) 12, No. 1, Paper No. 11, 13 p. (2019; Zbl 07052210)

Full Text:
DOI

##### References:

[1] | Zhang, W.; Zhang, Y.; Ma, L.; Guan, J.; Multimodal learning for facial expression recognition; Pattern Recognit.: 2015; Volume 48 ,3192-3202. |

[2] | Lekdioui, K.; Messoussi, R.; Ruichek, Y.; Facial decomposition for expression recognition using texture/shape descriptors and SVM classifier; Signal Process. Image Commun.: 2017; Volume 58 ,300-312. |

[3] | Allaert, B.; Mennesson, J.; Bilasco, I.M.; Impact of the face registration techniques on facial expressions recognition; Signal Process. Image Commun.: 2018; Volume 61 ,44-53. |

[4] | Liu, Y.; Facial Expression Recognition with Fusion Features Extracted from Salient Facial Areas; Sensors: 2017; Volume 17 . |

[5] | Stai, E.; Kafetzoglou, S.; Tsiropoulou, E.E.; Papavassiliou, S.; A holistic approach for personalization, relevance feedback & recommendation in enriched multimedia content; Multimed. Tools Appl.: 2018; Volume 77 ,283-326. |

[6] | Pouli, V.; Kafetzoglou, S.; Tsiropoulou, E.E.; Dimitriou, A.; Papavassiliou, S.; Personalized multimedia content retrieval through relevance feedback techniques for enhanced user experience; Proceedings of the IEEE 2015 13th International Conference on Telecommunications (ConTEL): ; ,1-8. |

[7] | Bobadilla, J.; Ortega, F.; Hernando, A.; Gutiérrez, A.; Recommender systems survey; Knowl.-Based Syst.: 2013; Volume 46 ,109-132. |

[8] | Balabanovic, M.; Shoham, Y.; Fab: Content-based, collaborative recommendation; Commun. ACM: 1997; Volume 40 ,66-72. |

[9] | Mohammadi, M.R.; Fatemizadeh, E.; Mahoor, M.H.; PCA-based dictionary building for accurate facial expression recognition via sparse representation; J. Vis. Commun. Image Represent.: 2014; Volume 25 ,1082-1092. |

[10] | Zhang, Y.D.; Yang, Z.J.; Lu, H.M.; Facial Emotion Recognition Based on Biorthogonal Wavelet Entropy, Fuzzy Support Vector Machine, and Stratified Cross Validation; IEEE Access.: 2017; Volume 4 ,8375-8385. |

[11] | Wang, S.H.; Yang, W.; Dong, Z.; Facial Emotion Recognition via Discrete Wavelet Transform, Principal Component Analysis, and Cat Swarm Optimization; Proceedings of the 7th International Conference on Intelligence Science and Big Data Engineering (IScIDE 2017): Berlin, Germany 2017; ,203-214. |

[12] | Selesnick, I.W.; Wavelets, a modern tool for signal processing; Phys. Today: 2007; Volume 60 ,78-79. |

[13] | Tang, M.; Chen, F.; Facial expression recognition and its application based on curvelet transform and PSO-SVM; Optik-Int. J. Light Electron Opt.: 2013; Volume 123 ,5401-5406. |

[14] | Hou, B.; Zhang, X.; Bu, X.; SAR Image Despeckling based on Nonsubsampled Shearlet Transform; IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.: 2012; Volume 5 ,809-823. |

[15] | Lim, W.Q.; The discrete shearlet transform: A new directional transform and compactly supported shearlet frames; IEEE Trans. Image Process.: 2010; Volume 19 ,1166-1180. · Zbl 1371.94233 |

[16] | Sun, W.Y.; ; Facial Expression Recognition Arithmetic Research: Beijing, China 2006; ,37-38. |

[17] | Battiti, R.; Using mutual information for selecting features in supervised neural net learning; IEEE Trans. Neural Netw.: 1994; Volume 5 ,537-550. |

[18] | Pablo, A.E.; Tesmer, M.; Perez, C.A.; Normalized Mutual Information Feature Selection; IEEE Trans. Neural Netw.: 2009; Volume 20 ,189-201. |

[19] | Wu, S.H.; Generalization and application of Jensen inequality reinforcement; J. Sichuan Univ. (Nat. Sci. Ed.): 2005; Volume 3 ,437-443. · Zbl 1101.26310 |

[20] | Hong, Y.Y.; Wu, C.P.; Day-Ahead Electricity Price Forecasting Using a Hybrid Principal Component Analysis Network; Energies: 2012; Volume 5 ,4711-4725. |

[21] | Wei, Y.; Yue, Y.; Research on Fault Diagnosis of a Marine Fuel System Based on the SaDE-ELM Algorithm; Algorithms: 2018; Volume 11 . |

[22] | Du, J.L.; Liu, Y.Y.; Yu, Y.N.; A Prediction of Precipitation Data Based on Support Vector Machine and Particle Swarm Optimization (PSO-SVM) Algorithms; Algorithms: 2017; Volume 10 . · Zbl 06920643 |

[23] | Lyons, M.; Akamatsu, S.; Kamachi, M.; Coding Facial Expressions with Gabor Wavelets; Proceedings of the 3rd IEEE International Conference on Automatic Face and Gesture Recognition: ; ,200-205. |

[24] | Lucey, P.; The extended Cohn-Kanade dataset (CK+): A complete expression dataset for action unit and emotion-specified expression; Proceedings of the IEEE 3rd International Workshop on CVPR for Human Communicative Behavior Analysis: ; ,94-101. |

[25] | Pantic, M.; Valstar, M.; Rademaker, R.; Maat, L.; Web-based database for facial expression analysis; Proceedings of the IEEE International Conference on Multimedia and Expo (ICME): ; ,5. |

[26] | PICS Database; ; . |

[27] | Lu, Y.; Wang, S.G.; Zhao, W.T.; Zhao, Y.; A novel approach of facial expression recognition based on shearlet transform; Proceedings of the IEEE 5th Global Conference on Signal and Information Processing (GlobalSIP): ; ,398-402. |

[28] | Ghimire, D.; Lee, J.; Geometric feature-based facial expression recognition in image sequences using multi-class AdaBoost and support vector machines; Sensors: 2013; Volume 13 ,7714-7734. |

[29] | Uçar, A.; Demir, Y.; Güzeliş, C.; A new facial expression recognition based on curvelet transform and online sequential extreme learning machine initialized with spherical clustering; Neural Comput. Appl.: 2016; Volume 27 ,131-142. |

[30] | Rivera, A.R.; Castillo, J.R.; Chae, O.; Local directional number pattern for face analysis: Face and expression recognition; IEEE Trans. Image Process.: 2013; Volume 22 ,1740-1752. · Zbl 1373.94341 |

[31] | Lu, G.M.; Li, X.N.; Li, H.B.; Research on Recognition for Facial Expression of Pain in Neonates; Acta Opt. Sin.: 2008; Volume 11 ,664-667. |

[32] | Li, Y.Q.; Li, Y.J.; Li, H.B.; Fusion of Global and Local Various Feature for Facial Expression Recognition; Acta Opt. Sin.: 2014; Volume 34 ,172-178. |

This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.