Abstract
In this paper we overview the 2014 Entity Recognition and Disambiguation Challenge (ERD'14), which took place from March to June 2014 and was summarized in a dedicated workshop at SIGIR 2014. The main goal of the ERD challenge was to promote research in recognition and disambiguation of entities in unstructured text. Unlike many past entity linking challenges, no mention segmentations were given to the participating systems for a given document. Participants were asked to implement a web service for their system to minimize human involvement during evaluation and to enable measuring the processing times. The challenge has attracted a lot of interest (over 100 teams registered, and 27 of those submitted final results).
In this paper we cover the task definition, issues encountered during annotation, and provide a detailed analysis of all the participating systems. Specifically, we show how we adapted the pooling technique to address the difficulties of gathering annotations for the entity linking task. We also summarize the ERD workshop that followed the challenge, including the oral and poster presentations as well as the invited talks.
Publisher
Association for Computing Machinery (ACM)
Subject
Hardware and Architecture,Management Information Systems
Cited by
30 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. A hybrid attention mechanism for multi-target entity relation extraction using graph neural networks;Machine Learning with Applications;2023-03
2. Semantic Similarity Entity Disambiguation for Short Text;2021 14th International Symposium on Computational Intelligence and Design (ISCID);2021-12
3. Conversational Entity Linking: Problem Definition and Datasets;Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval;2021-07-11
4. HOBBIT: A platform for benchmarking Big Linked Data;Data Science;2020-06-12
5. HEEL: exploratory entity linking for heterogeneous information networks;Knowledge and Information Systems;2019-04-01