The Impact of Score Ties on Repeatability in Document Ranking-Reference-Cited by-同舟云学术

The Impact of Score Ties on Repeatability in Document Ranking

Published:2019-07-18 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval
language:
Short-container-title:

Author:

Lin Jimmy¹,Yang Peilin²

Affiliation:

1. University of Waterloo, Waterloo, ON, Canada

2. No affiliation, San Francisco, CA, USA

Funder

Natural Sciences and Engineering Research Council of Canada

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3331184.3331339

Reference12 articles.

1. V. Anh O. de Kretser and A. Moffat. 2001. Vector-Space Ranking with Effective Early Termination. In SIGIR. 35--42. 10.1145/383952.383957 V. Anh O. de Kretser and A. Moffat. 2001. Vector-Space Ranking with Effective Early Termination. In SIGIR. 35--42. 10.1145/383952.383957

2. Report on the SIGIR 2015 Workshop on Reproducibility, Inexplicability, and Generalizability of Results (RIGOR)

3. G. Cabanac G. Hubert M. Boughanem and C. Chrisment. 2010. Tie-Breaking Bias: Effect of an Uncontrolled Parameter on Information Retrieval Evaluation. In CLEF. 112--123. G. Cabanac G. Hubert M. Boughanem and C. Chrisment. 2010. Tie-Breaking Bias: Effect of an Uncontrolled Parameter on Information Retrieval Evaluation. In CLEF. 112--123.

4. N. Ferro and G. Silvello. 2015. Rank-Biased Precision Reloaded: Reproducibility and Generalization. In ECIR. 768--780. N. Ferro and G. Silvello. 2015. Rank-Biased Precision Reloaded: Reproducibility and Generalization. In ECIR. 768--780.

5. J. Lin M. Crane A. Trotman J. Callan I. Chattopadhyaya J. Foley G. Ingersoll C. Macdonald and S. Vigna. 2016. Toward Reproducible Baselines: The Open-Source IR Reproducibility Challenge. In ECIR. 408--420. J. Lin M. Crane A. Trotman J. Callan I. Chattopadhyaya J. Foley G. Ingersoll C. Macdonald and S. Vigna. 2016. Toward Reproducible Baselines: The Open-Source IR Reproducibility Challenge. In ECIR. 408--420.

Cited by 15 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Revisiting Document Expansion and Filtering for Effective First-Stage Retrieval;Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval;2024-07-10

2. Revisiting Condorcet Fusion;Proceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval;2023-08-09

3. A Reproducibility Study of Question Retrieval for Clarifying Questions;Lecture Notes in Computer Science;2023

4. Bootstrapped nDCG Estimation in the Presence of Unjudged Documents;Lecture Notes in Computer Science;2023

5. ir_metadata: An Extensible Metadata Schema for IR Experiments;Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval;2022-07-06