Affiliation:
1. School of Artificial Intelligence Nanjing University of Information Science & Technology Nanjing China
2. School of Electronic & Information Engineering Nanjing University of Information Science & Technology Nanjing China
Abstract
AbstractThe purpose of text classification is to label the text with known labels. In recent years, the method based on graph neural network (GNN) has achieved good results. However, the existing methods based on GNN only regard the text as the set of co‐occurring words, without considering the position information of each word in the statement. At the same time, the method mainly extracts the node features in the graph, and the edge features between the nodes are not used enough. To solve these problems, a new text classification method, graph convolutional network using positions and edges, is proposed. In the word embedding section, a positional encoding input representation is employed to enable the neural network to learn the relative positional information among words. Meanwhile, the dimension of the adjacency matrix is increased to extract the multi‐dimensional edge features. Through experiments on multiple text classification datasets, the proposed method is shown to be superior to the traditional text classification method, and has achieved a maximum improvement of more than 4%.
Subject
Artificial Intelligence,Computational Theory and Mathematics,Theoretical Computer Science,Control and Systems Engineering
Reference31 articles.
1. A Survey of Text Classification Algorithms
2. Bakshi R. K. Kaur N. Kaur R. &Kaur G.(2016).Opinion mining and sentiment analysis. In 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom). 452–455.
3. Local-Aggregation Graph Networks
4. Devlin J. Chang M.‐W. Lee K. &Toutanova K.(2018).Bert: Pre‐training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.
5. Inductive representation learning on large graphs;Hamilton W.;Advances in Neural Information Processing Systems,2017