How to Measure the Reproducibility of System-oriented IR Experiments-Reference-Cited by-同舟云学术

How to Measure the Reproducibility of System-oriented IR Experiments

Published:2020-07-25 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval
language:
Short-container-title:

Author:

Breuer Timo¹,Ferro Nicola²,Fuhr Norbert³,Maistro Maria⁴,Sakai Tetsuya⁵,Schaer Philipp¹,Soboroff Ian⁶

Affiliation:

1. TH Köln, Cologne, Germany

2. University of Padua, Padua, Italy

3. Universität Duisburg-Essen, Duisburg, Germany

4. University of Copenhagen, Copenhagen, Denmark

5. Waseda University, Tokyo, Japan

6. National Institute of Standards and Technology (NIST), Gaithersburg, MD, USA

Funder

German Research Foundation (DFG)

Innovationsfonden Denmark

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3397271.3401036

Reference42 articles.

1. Report on the SIGIR 2015 Workshop on Reproducibility, Inexplicability, and Generalizability of Results (RIGOR);Arguello J.;SIGIR Forum,2015

2. T. Breuer N. Ferro N. Fuhr M. Maistro T. Sakai P. Schaer and I. Soboroff. 2020. How to Measure the Reproducibility of System-oriented IR Experiments. https://doi.org/10.5281/zenodo.3856042 T. Breuer N. Ferro N. Fuhr M. Maistro T. Sakai P. Schaer and I. Soboroff. 2020. How to Measure the Reproducibility of System-oriented IR Experiments. https://doi.org/10.5281/zenodo.3856042

3. T. Breuer and P. Schaer. 2019. Replicability and Reproducibility of Automatic Routing Runs. In Working Notes of CLEF 2019 - Conference and Labs of the Evaluation Forum Lugano Switzerland September 9-12 2019 (CEUR Workshop Proceedings) Linda Cappellato Nicola Ferro David E. Losada and Henning Mü ller (Eds.) Vol. 2380. CEUR-WS.org. http://ceur-ws.org/Vol-2380/paper_84.pdf T. Breuer and P. Schaer. 2019. Replicability and Reproducibility of Automatic Routing Runs. In Working Notes of CLEF 2019 - Conference and Labs of the Evaluation Forum Lugano Switzerland September 9-12 2019 (CEUR Workshop Proceedings) Linda Cappellato Nicola Ferro David E. Losada and Henning Mü ller (Eds.) Vol. 2380. CEUR-WS.org. http://ceur-ws.org/Vol-2380/paper_84.pdf

Cited by 15 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Validating Synthetic Usage Data in Living Lab Environments;Journal of Data and Information Quality;2023-09-24

2. The Information Retrieval Experiment Platform;Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval;2023-07-18

3. An in-depth investigation on the behavior of measures to quantify reproducibility;Information Processing & Management;2023-05

4. A Next Basket Recommendation Reality Check;ACM Transactions on Information Systems;2023-04-21

5. Trustworthy AI: From Principles to Practices;ACM Computing Surveys;2023-01-16