Author:
Zheng Zhiyun,Xu Yamei,Liu Yun,Zhang Xingjin,Li Lun,Li Dun
Abstract
AbstractRelation extraction is an important task in information extraction, which aims to identify the relation between two given entities. The algorithm based on distant supervision can automatically generate a large amount of annotated data, which becomes the main method to deal with the task of relation extraction. However, previous studies rely too much on the precision of supervision information and ignore the effective supervision information hidden in the case of mislabeling, which leads to the loss of supervision information. To solve this problem, we propose the distantly supervised relation extraction model based on residual attention and self-learning. The model uses residual attention to extract features, and then uses self-learning idea to generate corrected labels for training data, which are added into the training process as supervisory signals to prevent parameter error updates caused by noisy labels. The model can not only reduce the problem of mislabeling caused by distant supervision, but also makes full use of the available supervisory information in the data to improve data utilization. Experiments show that compared with the existing mainstream baseline methods, the proposed model has higher precision and recall.
Publisher
Springer Science and Business Media LLC
Reference26 articles.
1. Yang H, Liu Y, Kaiwen Z (2021) A review of distantly supervised relation extraction. Chin J Comput 44(8):1636–1660
2. Riedel S, Yao L, McCallum A (2010) Modeling relations and their mentions without labeled text. In: Joint European conference on machine learning and knowledge discovery in databases. Springer, Newyork, pp 148–163
3. Hoffmann R, Zhang C, Ling X, Zettlemoyer L, Weld DS (2011) Knowledge-based weak supervision for information extraction of overlapping relations. In: Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies, pp 541–550
4. Lin Y, Shen S, Liu Z, Luan H, Sun M (2016) Neural relation extraction with selective attention over instances. In: Proceedings of the 54th annual meeting of the association for computational linguistics (vol 1: long papers), pp 2124–2133
5. Ye Y, Xue H, Wang L (2020) Distant supervision neural network relation extraction based on noisy observation. Ruan Jian Xue Bao/J Softw 31(4)
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献