Affiliation:
1. Information Technology Department, National Institute of Technology Karnataka, Mangaluru 575025, India
Abstract
Nowadays, online examination (exam in short) platforms are becoming more popular, demanding strong security measures for digital learning environments. This includes addressing key challenges such as head pose detection and estimation, which are integral for applications like automatic face recognition, advanced surveillance systems, intuitive human–computer interfaces, and enhancing driving safety measures. The proposed work holds significant potential in enhancing the security and reliability of online exam platforms. It achieves this by accurately classifying students’ attentiveness based on distinct head poses, a novel approach that leverages advanced techniques like federated learning and deep learning models. The proposed work aims to classify students’ attentiveness with the help of different head poses. In this work, we considered five head poses: front face, down face, right face, up face, and left face. A federated learning (FL) framework with a pre-trained deep learning model (ResNet50) was used to accomplish the classification task. To classify students’ activity (behavior) in an online exam environment using the FL framework’s local client device, we considered the ResNet50 model. However, identifying the best hyperparameters in the local client ResNet50 model is challenging. Hence, in this study, we proposed two hybrid bio-inspired optimized methods, namely, Particle Swarm Optimization with Genetic Algorithm (PSOGA) and Particle Swarm Optimization with Elitist Genetic Algorithm (PSOEGA), to fine-tune the hyperparameters of the ResNet50 model. The bio-inspired optimized methods employed in the ResNet50 model will train and classify the students’ behavior in an online exam environment. The FL framework trains the client model locally and sends the updated weights to the server model. The proposed hybrid bio-inspired algorithms outperform the GA and PSO when independently used. The proposed PSOGA not only outperforms the proposed PSOEGA but also outperforms the benchmark algorithms considered for performance evaluation by giving an accuracy of 95.97%.
Reference56 articles.
1. A vision-based multi-cues approach for individual students’ and overall class engagement monitoring in smart classroom environments;Pabba;Multimed. Tools Appl.,2023
2. Exploring transfer learning approaches for head pose classification from multi-view surveillance images;Subramanian;Int. J. Comput. Vis.,2014
3. Afroze, S., and Hoque, M.M. (2020, January 3–5). Head pose classification based on deep convolution networks. Proceedings of the International Conference on Internet of Things and Connected Technologies, Patna, India.
4. Head pose estimation using facial-landmarks classification for children rehabilitation games;Malek;Pattern Recognit. Lett.,2021
5. Niu, Y., and Deng, W. (March, January 22). Federated learning for face recognition with gradient correction. Proceedings of the AAAI Conference on Artificial Intelligence, Online.