Human-Centered Evaluation and Auditing of Language Models-Reference-Cited by-同舟云学术

Human-Centered Evaluation and Auditing of Language Models

Published:2024-05-11 Issue: Volume: Page:1-6
ISSN:
Container-title:Extended Abstracts of the CHI Conference on Human Factors in Computing Systems
language:
Short-container-title:

Author:

Xiao Ziang¹^ORCID,Deng Wesley Hanwen²^ORCID,Lam Michelle S.³^ORCID,Eslami Motahhare⁴^ORCID,Kim Juho⁵^ORCID,Lee Mina⁶^ORCID,Liao Q. Vera⁷^ORCID

Affiliation:

1. Johns Hopkins University, United States and Microsoft Research, Canada

2. Human-Computer Interaction Institution, Carnegie Mellon University, United States

3. Dept. of Computer Science, Stanford University, United States

4. School of Computer Science, Carnegie Mellon University, United States

5. School of Computing, KAIST, Korea, Republic of

6. Microsoft Research, United States

7. Microsoft Research, Canada

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3613905.3636302

Reference52 articles.

1. Open AI. 2022. ChatGPT Feedback Contest: Official Rules. https://cdn.openai.com/chatgpt/ChatGPT_Feedback_Contest_Rules.pdf

2. Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, 2021. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258 (2021).

3. Discovering and Validating AI Errors With Crowdsourced Failure Reports

4. Zeno: An Interactive Framework for Behavioral Evaluation of Machine Learning

5. Rumman Chowdhury and Jutta Williams. 2021. Introducing Twitter’s first algorithmic bias bounty challenge. URl: https://blog. twitter. com/engineering/en_us/topics/insights/2021/algorithmic-bias-bountychallenge (2021).