Limitations of Open-Domain Question Answering Benchmarks for Document-level Reasoning-Reference-Cited by-同舟云学术

Limitations of Open-Domain Question Answering Benchmarks for Document-level Reasoning

Published:2023-07-18 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval
language:
Short-container-title:

Author:

Kamalloo Ehsan¹^ORCID,Clarke Charles L. A.¹^ORCID,Rafiei Davood²^ORCID

Affiliation:

1. University of Waterloo, Waterloo, ON, Canada

2. University of Alberta, Edmonton, AB, Canada

Funder

Huawei Canada

Natural Sciences and Engineering Research Council of Canada

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3539618.3592011

Reference56 articles.

1. Qingyao Ai , Brendan O'Connor , and W Bruce Croft . 2018. A neural passage model for ad-hoc document retrieval . In Advances in Information Retrieval . Springer International Publishing , 537--543. Qingyao Ai, Brendan O'Connor, and W Bruce Croft. 2018. A neural passage model for ad-hoc document retrieval. In Advances in Information Retrieval. Springer International Publishing, 537--543.

2. ETC: Encoding Long and Structured Inputs in Transformers

3. Challenges in Information-Seeking QA: Unanswerable Questions and Paragraph Retrieval

4. Utilizing passage-based language models for ad hoc document retrieval

5. Jonathan Berant , Andrew Chou , Roy Frostig , and Percy Liang . 2013 . Semantic Parsing on Freebase from Question-Answer Pairs . In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics , Seattle, Washington, USA, 1533--1544. Jonathan Berant, Andrew Chou, Roy Frostig, and Percy Liang. 2013. Semantic Parsing on Freebase from Question-Answer Pairs. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Seattle, Washington, USA, 1533--1544.