How to Measure the Reproducibility of System-oriented IR Experiments-Reference-Cited by-同舟云学术

How to Measure the Reproducibility of System-oriented IR Experiments

Published:2020-07-25 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval
language:
Short-container-title:

Author:

Breuer Timo¹,Ferro Nicola²,Fuhr Norbert³,Maistro Maria⁴,Sakai Tetsuya⁵,Schaer Philipp¹,Soboroff Ian⁶

Affiliation:

1. TH Köln, Cologne, Germany

2. University of Padua, Padua, Italy

3. Universität Duisburg-Essen, Duisburg, Germany

4. University of Copenhagen, Copenhagen, Denmark

5. Waseda University, Tokyo, Japan

6. National Institute of Standards and Technology (NIST), Gaithersburg, MD, USA

Funder

German Research Foundation (DFG)

Innovationsfonden Denmark

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3397271.3401036

Reference42 articles.

1. Report on the SIGIR 2015 Workshop on Reproducibility, Inexplicability, and Generalizability of Results (RIGOR);Arguello J.;SIGIR Forum,2015

2. T. Breuer N. Ferro N. Fuhr M. Maistro T. Sakai P. Schaer and I. Soboroff. 2020. How to Measure the Reproducibility of System-oriented IR Experiments. https://doi.org/10.5281/zenodo.3856042 T. Breuer N. Ferro N. Fuhr M. Maistro T. Sakai P. Schaer and I. Soboroff. 2020. How to Measure the Reproducibility of System-oriented IR Experiments. https://doi.org/10.5281/zenodo.3856042

3. T. Breuer and P. Schaer. 2019. Replicability and Reproducibility of Automatic Routing Runs. In Working Notes of CLEF 2019 - Conference and Labs of the Evaluation Forum Lugano Switzerland September 9-12 2019 (CEUR Workshop Proceedings) Linda Cappellato Nicola Ferro David E. Losada and Henning Mü ller (Eds.) Vol. 2380. CEUR-WS.org. http://ceur-ws.org/Vol-2380/paper_84.pdf T. Breuer and P. Schaer. 2019. Replicability and Reproducibility of Automatic Routing Runs. In Working Notes of CLEF 2019 - Conference and Labs of the Evaluation Forum Lugano Switzerland September 9-12 2019 (CEUR Workshop Proceedings) Linda Cappellato Nicola Ferro David E. Losada and Henning Mü ller (Eds.) Vol. 2380. CEUR-WS.org. http://ceur-ws.org/Vol-2380/paper_84.pdf

Cited by 19 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Evaluation of Temporal Change in IR Test Collections;Proceedings of the 2024 ACM SIGIR International Conference on Theory of Information Retrieval;2024-08-02

2. A Reproducibility Study of PLAID;Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval;2024-07-10

3. Toward Evaluating the Reproducibility of Information Retrieval Systems with Simulated Users;Proceedings of the 2nd ACM Conference on Reproducibility and Replicability;2024-06-18

4. Replicability Measures for Longitudinal Information Retrieval Evaluation;Lecture Notes in Computer Science;2024

5. Validating Synthetic Usage Data in Living Lab Environments;Journal of Data and Information Quality;2023-09-24