Affiliation:
1. School of Information Engineering, Inner Mongolia University of Technology, Hohhot 010051, China
2. School of Science, Inner Mongolia University of Technology, Hohhot 010051, China
Abstract
Animated Graphics Interchange Format (GIF) images have become an important part of network information interaction, and are one of the main characteristics of analyzing social media emotions. At present, most of the research on GIF affection recognition fails to make full use of spatial-temporal characteristics of GIF images, which limits the performance of model recognition to a certain extent. A GIF emotion recognition algorithm based on ResNet-ConvGRU is proposed in this paper. First, GIF data is preprocessed, converting its image sequences to static image format for saving. Then, the spatial features of images and the temporal features of static image sequences are extracted with ResNet and ConvGRU networks, respectively. At last, the animated GIFs data features are synthesized and the seven emotional intensities of GIF data are calculated. The GIFGIF dataset is used to verify the experiment. From the experimental results, the proposed animated GIFs emotion recognition model based on ResNet-ConvGRU, compared with the classical emotion recognition algorithms such as VGGNet-ConvGRU, ResNet3D, CNN-LSTM, and C3D, has a stronger feature extraction ability, and sentiment classification performance. This method provides a finer-grained analysis for the study of public opinion trends and a new idea for affection recognition of GIF data in social media.
Funder
National Natural Science Foundation of China
Subject
General Engineering,General Mathematics
Reference28 articles.
1. The Bigger Picture: Combining Econometrics with Analytics Improves Forecasts of Movie Success
2. Who falls for online political manipulation?;A. Badawy
3. Hashtag our stories: Hashtag recommendation for micro-videos via harnessing multiple modalities
4. Basic auditory processing and emotion recognition in individuals at clinical high risk for psychosis. Schizophrenia research;M. S. Kraus;Cognition,2021