CMCEE: A joint learning framework for cascade decoding with multi-feature fusion and conditional enhancement for overlapping event extraction
-
Published:2023-10-12
Issue:
Volume:
Page:1-16
-
ISSN:1088-467X
-
Container-title:Intelligent Data Analysis
-
language:
-
Short-container-title:IDA
Author:
Dai Zerui1ORCID, Tian Shengwei1ORCID, Yu Long2ORCID, Yang Qimeng1ORCID
Affiliation:
1. School of Software, Xinjiang University, Xinjiang, China 2. Network and Information Center, Xinjiang University, Xinjiang, China
Abstract
Event extraction (EE) is an important natural language processing task. With the passage of time, many powerful and effective models for event extraction tasks have been developed. However, there has been limited research on complex overlapping event extraction. Therefore, we propose a new cascade decoding model: A Joint Learning Framework for Cascade Decoding with Multi-Feature Fusion and Conditional Enhancement for Overlapping Event Extraction. 1) In this model, we introduce a cascade decoding mechanism with multi-feature fusion to better capture the interaction between decoding layers. 2) Additionally, we introduce an enhanced conditional layer normalization (ECLN) mechanism to enhance the interaction between subtasks. Simultaneously, the use of a cascade decoding model effectively addresses the problem of overlapping events. The model successively performs three subtasks, type detection, trigger word extraction and argument extraction. All three subtasks learned together in a framework, and a new conditional normalization mechanism is used to capture dependencies among these subtasks. The experiments are conducted using the overlapping event benchmark, FewFC dataset. The experimental evaluation demonstrates that our model achieves a higher F1 score on the overlapping event extraction task compared to the original overlapping event extraction model.
Subject
Artificial Intelligence,Computer Vision and Pattern Recognition,Theoretical Computer Science
Reference18 articles.
1. Y. Chen, L. Xu, K. Liu, D. Zeng and J. Zhao, Event extraction via dynamic multi-pooling convolutional neural networks, in: Association for Computational Linguistics, Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Vol. 1, 2015, pp. 167–176. 2. Y. Chen, T. Chen, S. Ebner, A.S. White and B. Van Durme, Reading the Manual: Event Extraction as Definition Comprehension, in: Association for Computational Linguistics, Proceedings of the Fourth Workshop on Structured Prediction for NLP, 2020, pp. 74–83. 3. H. De Vries, F. Strub, J. Mary, H. Larochelle, O. Pietquin and A.C. Courville, Modulating early visual processing by language, Advances in Neural Information Processing Systems 30 (2017). 4. J. Devlin, M.W. Chang, K. Lee and K. Toutanova, BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding, in: Association for Computational Linguistics, Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol. 1, 2019, pp. 4171–4186. 5. X. Du and C. Cardie, Event Extraction by Answering (Almost) Natural Questions, in: Association for Computational Linguistics, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020, pp. 671–683.
|
|