Preferences on a Budget: Prioritizing Document Pairs when Crowdsourcing Relevance Judgments-Reference-Cited by-同舟云学术

Preferences on a Budget: Prioritizing Document Pairs when Crowdsourcing Relevance Judgments

Published:2022-04-25 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the ACM Web Conference 2022
language:
Short-container-title:

Author:

Roitero Kevin¹,Checco Alessandro²,Mizzaro Stefano¹,Demartini Gianluca³

Affiliation:

1. University of Udine, Italy

2. University of Sheffield, United Kingdom

3. University of Queensland, Australia

Funder

ARC Discovery Project

ARC Training Centre for Information Resilience

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3485447.3511960

Reference35 articles.

1. Javed A. Aslam and Mark Montague. 2001. Models for Metasearch . In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval ( New Orleans, Louisiana, USA) (SIGIR ’01). Association for Computing Machinery, New York, NY, USA, 276–284. https://doi.org/10.1145/383952.384007 10.1145/383952.384007 Javed A. Aslam and Mark Montague. 2001. Models for Metasearch. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (New Orleans, Louisiana, USA) (SIGIR ’01). Association for Computing Machinery, New York, NY, USA, 276–284. https://doi.org/10.1145/383952.384007

2. A document rating system for preference judgements

3. Rank Analysis of Incomplete Block Designs;Bradley Ralph Allan;I. The Method of Paired Comparisons. Biometrika,1952

4. Evaluation measures for preference judgments

5. Here or There

Cited by 5 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Reliable Information Retrieval Systems Performance Evaluation: A Review;IEEE Access;2024

2. A Preference Judgment Tool for Authoritative Assessment;Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval;2023-07-18

3. Extending Label Aggregation Models with a Gaussian Process to Denoise Crowdsourcing Labels;Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval;2023-07-18

4. Implications and New Directions for IR Research and Practices;A Behavioral Economics Approach to Interactive Information Retrieval;2023

5. Human Preferences as Dueling Bandits;Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval;2022-07-06