Wikibench: Community-Driven Data Curation for AI Evaluation on Wikipedia-Reference-Cited by-同舟云学术

登录注册会员服务联系我们

Wikibench: Community-Driven Data Curation for AI Evaluation on Wikipedia

Published:2024-05-11 Issue: Volume:35 Page:1-24
ISSN:
Container-title:Proceedings of the CHI Conference on Human Factors in Computing Systems
language:
Short-container-title:

Author:

Kuo Tzu-Sheng¹^ORCID,Halfaker Aaron Lee²^ORCID,Cheng Zirui³^ORCID,Kim Jiwoo⁴^ORCID,Wu Meng-Hsin⁵^ORCID,Wu Tongshuang¹^ORCID,Holstein Kenneth¹^ORCID,Zhu Haiyi¹^ORCID

Affiliation:

1. Human-Computer Interaction Institute, Carnegie Mellon University, United States

2. Office of Applied Research, Microsoft, United States

3. Department of Computer Science and Technology, Tsinghua University, China

4. Columbia University, United States

5. School of Computer Science, Carnegie Mellon University, United States

Funder

NSF (National Science Foundation)

Block Center for Technology and Society

National Science Foundation

Underwriters Laboratories & the Center for Advancing Safety of Machine Intelligence

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3613904.3642278

Reference97 articles.

1. Lora Mois Aroyo and Praveen Kumar Paritosh. 2021. Adversarial Test Set for Image Classification: Lessons Learned from CATS4ML Data Challenge. (2021).

2. Beat the Machine

3. Yuanchen Bai, Raoyi Huang, Vijay Viswanathan, Tzu-Sheng Kuo, and Tongshuang Wu. 2023. Measuring Adversarial Datasets. arXiv preprint arXiv:2311.03566 (2023).

4. Fine-tuning language models to find agreement among humans with diverse preferences;Bakker Michiel;Advances in Neural Information Processing Systems,2022

5. Beat the AI: Investigating Adversarial Human Annotation for Reading Comprehension

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线，采集、加工和组织学术论文而形成的新型学术文献查询和分析系统，可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容，当前同舟云学术共收录了国内外主流学术期刊6万余种，收集的期刊论文及会议论文总量共计约1.5亿篇，并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询！咨询电话：010-8811{复制后删除}0370

www.globalauthorid.com

TOP