A Test Collection of Synthetic Documents for Training Rankers: ChatGPT vs. Human Experts-Reference-Cited by-同舟云学术

A Test Collection of Synthetic Documents for Training Rankers: ChatGPT vs. Human Experts

Published:2023-10-21 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 32nd ACM International Conference on Information and Knowledge Management
language:
Short-container-title:

Author:

Askari Arian¹^ORCID,Aliannejadi Mohammad²^ORCID,Kanoulas Evangelos²^ORCID,Verberne Suzan³^ORCID

Affiliation:

1. Leiden Institute of Advanced Computer Science, Leiden University, Leiden, Netherlands

2. University of Amsterdam, Amsterdam, Netherlands

3. LIACS, Leiden University, Leiden, Netherlands

Funder

EU Horizon 2020 ITN/ETN on Domain Specific Systems for Information Extraction and Retrieval

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3583780.3615111

Reference44 articles.

1. Amin Abolghasemi , Suzan Verberne , Arian Askari , and Leif Azzopardi . 2023 . Retrievability Bias Estimation Using Synthetically Generated Queries. In The 32nd ACM International Conference on Information and Knowledge Management (CIKM 2023). ACM. Amin Abolghasemi, Suzan Verberne, Arian Askari, and Leif Azzopardi. 2023. Retrievability Bias Estimation Using Synthetically Generated Queries. In The 32nd ACM International Conference on Information and Knowledge Management (CIKM 2023). ACM.

2. Arian Askari , Amin Abolghasemi , Gabriella Pasi , Wessel Kraaij , and Suzan Verberne . 2023. Injecting the BM25 Score as Text Improves BERT-Based Re-rankers . In Advances in Information Retrieval . Springer Nature Switzerland , Cham , 66--83. Arian Askari, Amin Abolghasemi, Gabriella Pasi, Wessel Kraaij, and Suzan Verberne. 2023. Injecting the BM25 Score as Text Improves BERT-Based Re-rankers. In Advances in Information Retrieval. Springer Nature Switzerland, Cham, 66--83.

3. Luiz Bonifacio , Hugo Abonizio , Marzieh Fadaee , and Rodrigo Nogueira . 2022 . Inpars: Data augmentation for information retrieval using large language models. arXiv preprint arXiv:2202.05144 (2022). Luiz Bonifacio, Hugo Abonizio, Marzieh Fadaee, and Rodrigo Nogueira. 2022. Inpars: Data augmentation for information retrieval using large language models. arXiv preprint arXiv:2202.05144 (2022).

4. Leonid Boytsov , Preksha Patel , Vivek Sourabh , Riddhi Nisar , Sayani Kundu , Ramya Ramanathan , and Eric Nyberg . 2023. InPars-Light: Cost-Effective Unsupervised Training of Efficient Rankers. arXiv preprint arXiv:2301.02998 ( 2023 ). Leonid Boytsov, Preksha Patel, Vivek Sourabh, Riddhi Nisar, Sayani Kundu, Ramya Ramanathan, and Eric Nyberg. 2023. InPars-Light: Cost-Effective Unsupervised Training of Efficient Rankers. arXiv preprint arXiv:2301.02998 (2023).

5. Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell etal 2020. Language models are few-shot learners. Advances in neural information processing systems Vol. 33 (2020) 1877--1901. Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell et al. 2020. Language models are few-shot learners. Advances in neural information processing systems Vol. 33 (2020) 1877--1901.

Cited by 5 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Report on the Search Futures Workshop at ECIR 2024;ACM SIGIR Forum;2024-06

2. CoachLM: Automatic Instruction Revisions Improve the Data Quality in LLM Instruction Tuning;2024 IEEE 40th International Conference on Data Engineering (ICDE);2024-05-13

3. Let the LLMs Talk: Simulating Human-to-Human Conversational QA via Zero-Shot LLM-to-LLM Interactions;Proceedings of the 17th ACM International Conference on Web Search and Data Mining;2024-03-04

4. Analyzing Adversarial Attacks on Sequence-to-Sequence Relevance Models;Lecture Notes in Computer Science;2024

5. Report on the 21st Dutch-Belgian Information Retrieval Workshop (DIR 2023);ACM SIGIR Forum;2023-12