Affiliation:
1. University of Amsterdam, Amsterdam, The Netherlands
2. University of Stavanger, Stavanger, Norway
Abstract
We report on our experience with TREC OpenSearch, an online evaluation campaign that enabled researchers to evaluate their experimental retrieval methods using real users of a live website. Specifically, we focus on the task of
ad hoc
document retrieval within the academic search domain, and work with two search engines, CiteSeerX and SSOAR, that provide us with traffic. We describe our experimental platform, which is based on the living labs methodology, and report on the experimental results obtained. We also share our experiences, challenges, and the lessons learned from running this track in 2016 and 2017.
Funder
Ahold Delhaize, Amsterdam Data Science, the Bloomberg Research Grant Program, the Criteo Faculty Research Award Program, Elsevier
the Microsoft Research Ph.D. Program, the Netherlands Institute for Sound and Vision, the Netherlands Organisation for Scientific Research
Yandex
European Community’s Seventh Framework Programme
Publisher
Association for Computing Machinery (ACM)
Subject
Information Systems and Management,Information Systems
Cited by
14 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献