Interaction Information Guided Prototype Representation Rectification for Few-Shot Relation Extraction
-
Published:2023-07-03
Issue:13
Volume:12
Page:2912
-
ISSN:2079-9292
-
Container-title:Electronics
-
language:en
-
Short-container-title:Electronics
Author:
Ma Xiaoqin12, Qin Xizhong12, Liu Junbao12, Ran Wensheng3
Affiliation:
1. College of Information Science and Engineering, Xinjiang University, Urumqi 830049, China 2. Xinjiang Key Laboratory of Signal Detection and Processing, Urumqi 830049, China 3. Xinjiang Uygur Autonomous Regin Product Quality Supervision and Inspection Institute, Urumqi 830049, China
Abstract
Few-shot relation extraction aims to identify and extract semantic relations between entity pairs using only a small number of annotated instances. Many recently proposed prototype-based methods have shown excellent performance. However, existing prototype-based methods ignore the hidden inter-instance interaction information between the support and query sets, leading to unreliable prototypes. In addition, the current optimization of the prototypical network only relies on cross-entropy loss. It is only concerned with the accuracy of the predicted probability for the correct label, ignoring the differences of other non-correct labels, which cannot account for relation discretization in semantic space. This paper proposes an attentional network of interaction information to obtain a more reliable relation prototype. Firstly, an inter-instance interaction information attention module is designed to mitigate prototype unreliability through interaction information between the support set and query set instances, utilizing category information hidden in the query set. Secondly, the similarity scalar, which is defined by the mixed features of the prototype and the relation and is added to the focal loss to improve the attention of hard examples. We conducted extensive experiments on two standard datasets and demonstrated the validity of our proposed model.
Funder
Major science and technology special projects of Xinjiang Uygur Autonomous Region Key technology development and application demonstration of integrated food data supervision platform in Xinjiang region
Subject
Electrical and Electronic Engineering,Computer Networks and Communications,Hardware and Architecture,Signal Processing,Control and Systems Engineering
Reference59 articles.
1. Han, X., Gao, T., Lin, Y., Peng, H., Yang, Y., Xiao, C., Liu, Z., Li, P., Zhou, J., and Sun, M. (2020, January 4–7). More Data, More Relations, More Context and More Openness: A Review and Outlook for Relation Extraction. Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, Suzhou, China. 2. A survey on knowledge graphs: Representation, acquisition, and applications;Ji;IEEE Trans. Neural Netw. Learn. Syst.,2021 3. Kambhatla, N., Born, L., and Sarkar, A. (2022, January 22–27). CipherDAug: Ciphertext based Data Augmentation for Neural Machine Translation. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Dublin, Ireland. 4. A Bayesian end-to-end model with estimated uncertainties for simple question answering over knowledge bases;Zhang;Comput. Speech Lang.,2021 5. Generalizing from a few examples: A survey on few-shot learning;Wang;ACM Comput. Surv.,2020
|
|