Affiliation:
1. School of Computer and Communication Engineering, Zhengzhou University of Light Industry, Zhengzhou 450002, China
Abstract
With the continuous rise of information technology and social networks, and the explosive growth of network text information, text sentiment analysis technology now plays a vital role in public opinion monitoring and product development analysis on networks. Text data are high-dimensional and complex, and traditional binary classification can only classify sentiment from positive or negative aspects. This does not fully cover the various emotions of users, and, therefore, natural language semantic sentiment analysis has limitations. To solve this deficiency, we propose a new model for analyzing text sentiment that combines deep learning and the bidirectional encoder representation from transformers (BERT) model. We first use an advanced BERT language model to convert the input text into dynamic word vectors; then, we adopt a convolutional neural network (CNN) to obtain the relatively significant partial emotional characteristics of the text. After extraction, we use the bidirectional recurrent neural network (BiGRU) to bidirectionally capture the contextual feature message of the text. Finally, with the MultiHeadAttention mechanism we obtain correlations among the data in different information spaces from different subspaces so that the key information related to emotion in the text can be selectively extracted. The final emotional feature representation obtained is classified using Softmax. Compared with other similar existing methods, our model in this research paper showed a good effect in comparative experiments on an e-commerce text dataset, and the accuracy and F1-score of the classification were significantly improved.
Funder
Project of Science and Technology Research in Henan Province of China
Subject
Electrical and Electronic Engineering,Computer Networks and Communications,Hardware and Architecture,Signal Processing,Control and Systems Engineering
Reference42 articles.
1. Qin, Z., Shuai, Q.H., Zhang, R.G., Ye, Q.W., Xiong, L., and Cao, J. (2023). E-Commerce Big Data Mining and Analytics. Advanced Studies in E-Commerce, Springer.
2. Challenges and Issues in Sentiment Analysis: A Comprehensive Survey;Raghunathan;IEEE Access,2023
3. Semi-supervised learning for big social data analysis;Hussain;Neurocomputing,2018
4. Sentiment Analysis in E-Commerce Platforms: A Review of Current Techniques and Future Directions;Huang;IEEE Access,2023
5. Sentiment classification using machine learning techniques;Wawre;Int. J. Sci. Res.,2016