Affiliation:
1. Key Laboratory of Data Science and Intelligence Education, Hainan Normal University, Ministry of Education, Haikou 571158, China
2. College of Information and Communication Engineering, Dalian Nationalities University, Dalian 116000, China
Abstract
With the widespread application of information technology in education, the real-time detection of student behavior in the classroom has become a key issue in improving teaching quality. This paper proposes a Student Behavior Detection (SBD) model that combines YOLOv5, the Contextual Attention (CA) mechanism and OpenPose, aiming to achieve efficient and accurate behavior recognition in complex classroom environments. By integrating YOLOv5 with the CA attention mechanism to enhance feature extraction capabilities, the model’s recognition performance in complex backgrounds, such as those with occlusion, is significantly improved. In addition, the feature map generated by the improved YOLOv5 is used to replace VGG-19 in OpenPose, which effectively improves the accuracy of student posture recognition. The experimental results demonstrate that the proposed model achieves a maximum mAP of 82.1% in complex classroom environments, surpassing Faster R-CNN by 5.2 percentage points and YOLOv5 by 4.6 percentage points. Additionally, the F1 score and R value of this model exhibit clear advantages over the other two traditional methods. This model offers an effective solution for intelligent classroom behavior analysis and the optimization of educational management.
Funder
Key Laboratory of Data Science and Intelligence Education (Hainan Normal University), the Ministry of Education, China
Reference23 articles.
1. A review on artificial intelligence in education;Huang;Acad. J. Interdiscip. Stud.,2021
2. Automatic detection of mind wandering from video in the lab and in the classroom;Bosch;IEEE Trans. Affect. Comput.,2019
3. A Review of Yolo algorithm developments;Jiang;Procedia Comput. Sci.,2022
4. Chen, H., Zhou, G., and Jiang, H. (2023). Student behavior detection in the classroom based on improved YOLOv8. Sensors, 23.
5. BiTNet: A lightweight object detection network for real-time classroom behavior recognition with transformer and bi-directional pyramid network;Zhao;J. King Saud Univ.-Comput. Inf. Sci.,2023