Interaction Information Guided Prototype Representation Rectification for Few-Shot Relation Extraction

Author:

Ma Xiaoqin12,Qin Xizhong12,Liu Junbao12,Ran Wensheng3

Affiliation:

1. College of Information Science and Engineering, Xinjiang University, Urumqi 830049, China

2. Xinjiang Key Laboratory of Signal Detection and Processing, Urumqi 830049, China

3. Xinjiang Uygur Autonomous Regin Product Quality Supervision and Inspection Institute, Urumqi 830049, China

Abstract

Few-shot relation extraction aims to identify and extract semantic relations between entity pairs using only a small number of annotated instances. Many recently proposed prototype-based methods have shown excellent performance. However, existing prototype-based methods ignore the hidden inter-instance interaction information between the support and query sets, leading to unreliable prototypes. In addition, the current optimization of the prototypical network only relies on cross-entropy loss. It is only concerned with the accuracy of the predicted probability for the correct label, ignoring the differences of other non-correct labels, which cannot account for relation discretization in semantic space. This paper proposes an attentional network of interaction information to obtain a more reliable relation prototype. Firstly, an inter-instance interaction information attention module is designed to mitigate prototype unreliability through interaction information between the support set and query set instances, utilizing category information hidden in the query set. Secondly, the similarity scalar, which is defined by the mixed features of the prototype and the relation and is added to the focal loss to improve the attention of hard examples. We conducted extensive experiments on two standard datasets and demonstrated the validity of our proposed model.

Funder

Major science and technology special projects of Xinjiang Uygur Autonomous Region

Key technology development and application demonstration of integrated food data supervision platform in Xinjiang region

Publisher

MDPI AG

Subject

Electrical and Electronic Engineering,Computer Networks and Communications,Hardware and Architecture,Signal Processing,Control and Systems Engineering

Reference59 articles.

1. Han, X., Gao, T., Lin, Y., Peng, H., Yang, Y., Xiao, C., Liu, Z., Li, P., Zhou, J., and Sun, M. (2020, January 4–7). More Data, More Relations, More Context and More Openness: A Review and Outlook for Relation Extraction. Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, Suzhou, China.

2. A survey on knowledge graphs: Representation, acquisition, and applications;Ji;IEEE Trans. Neural Netw. Learn. Syst.,2021

3. Kambhatla, N., Born, L., and Sarkar, A. (2022, January 22–27). CipherDAug: Ciphertext based Data Augmentation for Neural Machine Translation. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Dublin, Ireland.

4. A Bayesian end-to-end model with estimated uncertainties for simple question answering over knowledge bases;Zhang;Comput. Speech Lang.,2021

5. Generalizing from a few examples: A survey on few-shot learning;Wang;ACM Comput. Surv.,2020

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3