Affiliation:
1. Faculty of Engineering Sciences Academy of Scientific & Innovative Research (AcSIR) Ghaziabad Uttar Pradesh India
2. Intelligent Systems Group CSIR‐Central Electronics Engineering Research Institute Pilani Rajasthan India
Abstract
AbstractFacial expression recognition (FER) in the wild is an active and challenging field of research. A system for automatic FER finds use in a wide range of applications related to advanced human–computer interaction (HCI), human–robot interaction (HRI), human behavioral analysis, gaming and entertainment, etc. Since their inception, convolutional neural networks (CNNs) have attained state‐of‐the‐art accuracy in the facial analysis task. However, recognizing facial expressions in the wild with high confidence running on a low‐cost embedded device remains challenging. To this end, this study presents an efficient dual‐channel ensembled deep CNN (DCE‐DCNN) for FER in the wild. Initially, two DCNNs, namely the and , are trained separately on the grayscale and Scharr‐convolved vertical gradient facial images, respectively. The proposed network later integrates the two pre‐trained DCNNs to obtain the dual‐channel integrated DCNN (DCI‐DCNN). Finally, all three neural networks, namely the , , and DCI‐DCNN, are jointly fine‐tuned to get a single dual‐channel‐multi‐output model. The multi‐output model produces three prediction scores for the given input facial image. The prediction scores are thus fused using the max‐voting ensemble scheme to obtain the DCE‐DCNN with the final classification label. On the FER2013, RAF‐DB, NCAER‐S, AffectNet, and CKPlus benchmark FER datasets, the proposed DCE‐DCNN consistently outperforms the two individual DCNNs and numerous state‐of‐the‐art CNNs. Moreover, the network achieves competitive recognition accuracy on all four FER in the wild datasets with reduced memory storage size and parameters. The proposed DCE‐DCNN model with high throughput on resource‐limited embedded devices is suitable for applications that seek real‐time classification of facial expressions in the wild with high confidence.
Subject
Artificial Intelligence,Computational Mathematics
Reference85 articles.
1. Deep learning inspired intelligent embedded system for haptic rendering of facial emotions to the blind;Saurav S;Neural Comput Applic,2022
2. Facial emotion recognition and encoding application for the visually impaired;Pushpalatha M;Neural Comput Applic,2022
3. Review of automated emotion‐based quantification of facial expression in parkinson's patients;Sonawane B;Vis Comput,2020
4. Deep convolution network based emotion analysis towards mental health care
5. Three-dimensional DenseNet self-attention neural network for automatic detection of student’s engagement
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献