An Effective Strategy for Sentiment Analysis Based on Complex-Valued Embedding and Quantum Long Short-Term Memory Neural Network
Author:
Chu Zhulu1ORCID, Wang Xihan1, Jin Meilin1, Zhang Ning2ORCID, Gao Quanli1, Shao Lianhe1ORCID
Affiliation:
1. School of Computer Science, Xi’an Polytechnic University, Xi’an 710600, China 2. Library Information and Digital Library, National Library of China, Beijing 100081, China
Abstract
Sentiment analysis aims to study, analyse and identify the sentiment polarity contained in subjective documents. In the realm of natural language processing (NLP), the study of sentiment analysis and its subtask research is a hot topic, which has very important significance. The existing sentiment analysis methods based on sentiment lexicon and machine learning take into account contextual semantic information, but these methods still lack the ability to utilize context information, so they cannot effectively encode context information. Inspired by the concept of density matrix in quantum mechanics, we propose a sentiment analysis method, named Complex-valued Quantum-enhanced Long Short-term Memory Neural Network (CQLSTM). It leverages complex-valued embedding to incorporate more semantic information and utilizes the Complex-valued Quantum-enhanced Long Short-term Memory Neural Network for feature extraction. Specifically, a complex-valued neural network based on density matrix is used to capture interactions between words (i.e., the correlation between words). Additionally, the Complex-valued Quantum-enhanced Long Short-term Memory Neural Network, which is inspired by the quantum measurement theory and quantum long short-term memory neural network, is developed to learn interactions between sentences (i.e., contextual semantic information). This approach effectively encodes semantic dependencies, which reflects the dispersion of words in the embedded space of sentences and comprehensively captures interactive information and long-term dependencies among the emotional features between words. Comparative experiments were performed on four sentiment analysis datasets using five traditional models, showcasing the effectiveness of the CQLSTM model.
Funder
Natural Science Foundation of China Shaanxi Provincial Key Industry Innovation Chain Program Natural Science Basis Research Plan in Shaanxi Province of China Xi’an Major Scientific and Technological Achievements Transformation Industrialization Project
Reference47 articles.
1. Sordoni, A., Nie, J.-Y., and Bengio, Y. (August, January 28). Modeling term dependencies with quantum language models for IR. Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval, Dublin, Ireland. 2. Wang, P., Wang, T., Hou, Y., and Song, D. (2018). Advances in Information Retrieval: 40th European Conference on IR Research, ECIR 2018, Grenoble, France, 26–29 March 2018, Proceedings 40, Springer. 3. Li, Q., Melucci, M., and Tiwari, P. (2018, January 14–17). Quantum language model-based query expansion. Proceedings of the 2018 ACM SIGIR International Conference on Theory of Information Retrieval, Tianjin, China. 4. A quantum-inspired multimodal sentiment analysis framework;Zhang;Theor. Comput. Sci.,2018 5. Zhang, P., Niu, J., Su, Z., Wang, B., Ma, L., and Song, D. (2018, January 2–7). End-to-end quantum-like language models with application to question answering. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.
|
|