Affiliation:
1. College of Computer and Information Science, Chongqing Normal University, Chongqing, P. R. China
2. The Personnel Department, Chongqing Normal University, Chongqing, P. R. China
Abstract
In the process of learning, learners will express their emotions through a variety of forms, facial expressions and voice are more obvious, which are most easily obtained through computers. In the previous methods, it is mainly based on a single modal, such as expression, speech, text and so on. Due to the diversity of information, the accuracy rate of multimodal recognition is higher than that of single modal recognition. Therefore, this paper proposed a DNN-based multimodal learning emotion analysis method which combines video and speech to detect students’ learning emotion in real time. We use this method to automatically identify learning emotions in primary school English classroom. According to different learning emotions, the PAD emotion scale was used to correspond learning emotions with learning states. Teachers can judge students’ learning state according to the change of students’ learning emotions, so as to adjust teaching methods and strategies in time.
Funder
nsfc under grant number
science and technology project of chongqing education commission of china
Publisher
World Scientific Pub Co Pte Ltd
Subject
Computer Networks and Communications
Cited by
5 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献