Increasing Reproducibility in IR-Reference-Cited by-同舟云学术

Increasing Reproducibility in IR

Published:2016-06-27 Issue:1 Volume:50 Page:68-82
ISSN:0163-5840
Container-title:ACM SIGIR Forum
language:en
Short-container-title:SIGIR Forum

Author:

Ferro Nicola¹,Fuhr Norbert²,Järvelin Kalervo³,Kando Noriko⁴,Lippold Matthias²,Zobel Justin⁵

Affiliation:

1. University of Padua, Italy

2. University of Duisburg-Essen, Germany

3. University of Tampere, Finland

4. National Institute of Informatics, Japan

5. University of Melbourne, Australia

Abstract

The Dagstuhl Seminar on "Reproducibility of Data-Oriented Experiments in e-Science", held on 24-29 January 2016, focused on the core issues and approaches to reproducibility of experiments from a multidisciplinary point of view, sharing the experience coming from several fields of computer science. In this paper, we discuss, summarize, and adapt the main findings of the seminar to the context of IR evaluation -- both system-oriented and user-oriented -- in order to raise awareness in our community and stimulate the fields towards and increased reproducibility of our experiments.

Publisher

Association for Computing Machinery (ACM)

Subject

Hardware and Architecture,Management Information Systems

Link

https://dl.acm.org/doi/pdf/10.1145/2964797.2964808

Reference26 articles.

1. Towards an infrastructure for digital library performance evaluation

2. DESIRE 2011

3. Report on the SIGIR 2015 Workshop on Reproducibility, Inexplicability, and Generalizability of Results (RIGOR)

4. EvaluatIR

5. Panel on use of proprietary data

Cited by 42 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Browsing and Searching Metadata of TREC;Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval;2024-07-10

2. Reproduction and Simulation of Interactive Retrieval Experiments;Lecture Notes in Computer Science;2024

3. The Information Retrieval Experiment Platform;Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval;2023-07-18

4. An in-depth investigation on the behavior of measures to quantify reproducibility;Information Processing & Management;2023-05

5. Documentation strategy for facilitating the reproducibility of geo-simulation experiments;Environmental Modelling & Software;2023-05