Quantum-inspired meta-heuristic algorithms with deep learning for facial expression recognition under varying yaw angles

Abstract

In recent years, the increasing human–computer interaction has spurred the interest of researchers towards facial expression recognition to determine the expressive changes in human beings. The detection of relevant features that describe the expressions of different individuals is vital to describe human expressions accurately. The present work has employed the integrated concept of Local Binary Pattern and Histogram of Gradient for facial feature extraction. The major contribution of the paper is the optimization of the extracted features using quantum-inspired meta-heuristic algorithms of QGA (Quantum-Inspired Genetic Algorithm), QGSA (Quantum-Inspired Gravitational Search Algorithm), QPSO (Quantum-Inspired Particle Swarm Optimization), and QFA (Quantum-Inspired Firefly Algorithm). These quantum-inspired meta-heuristic algorithms utilize the attributes of quantum computing that ensure the adequate control of facial feature diversity with quantum measures and Q-bit superstition states. The optimized features are fed to the deep learning (DL) variant deep convolutional neural network added with residual blocks (DCNN-R) for the classification of expressions. The facial expressions are detected for the KDEF and RaFD datasets under varying yaw angles of –90∘, –45∘, 0∘, 45∘, and 90∘. The detection of facial expressions with varying angles is also a crucial contribution, as the features decrease with the increasing yaw angle movement of the face. The experimental evaluations demonstrate the superior performance of the QFA than other algorithms for feature optimization and hence the better classification of facial expressions.