Affiliation:
1. School of Information and Communication, National University of Defense Technology, Wuhan 430074, China
Abstract
Entity relation extraction mainly extracts relations from text, which is one of the important tasks of natural language processing. At present, some special fields have insufficient data; for example, agriculture, the metallurgical industry, etc. There is a lack of an effective model for entity relationship recognition under the condition of insufficient data. Inspired by this, we constructed a suitable small balanced data set and proposed a multi-neural network collaborative model (RBF, Roberta–Bidirectional Gated Recurrent Unit–Fully Connected). In addition, we also optimized the proposed model. This model uses the Roberta model as the coding layer, which is used to extract the word-level features of the text. This model uses BiGRU (Bidirectional Gated Recurrent Unit)–FC (Fully Connected) as the decoding layer, which is used to obtain the optimal relationship of the text. To further improve the effect, the input layer is optimized by feature fusion, and the learning rate is optimized by the cosine annealing algorithm. The experimental results show that, using the small balanced data set, the F1 value of the RBF model proposed in the paper is 25.9% higher than the traditional Word2vec–BiGRU–FC model. It is 18.6% higher than the recent Bert–BiLSTM (Bidirectional Long Short Term Memory)–FC model. The experimental results show that our model is effective.
Funder
National Natural Science Foundation of China
Subject
Fluid Flow and Transfer Processes,Computer Science Applications,Process Chemistry and Technology,General Engineering,Instrumentation,General Materials Science
Reference43 articles.
1. Predicting the performance of big data applications on the cloud;Ardagna;J. Supercomput.,2021
2. A new joint model for extracting overlapping relations based on deeplearning;Zhao;J. Univ. Chin. Acad. Sci.,2022
3. Chinese named entity recognition based on transfer learning and bilstm-crf;Wu;J. Chin. Comput. Syst.,2019
4. A joint model for entity and relation extraction based on BERT;Qiao;Neural Comput. Appl.,2022
5. Ma, L., Ren, H., and Zhang, X. (2021). Effective cascade dual-decoder model for joint entity and relation extraction. arXiv.
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献