Affiliation:
1. Human-centered Design & Engineering, University of Washington
Abstract
Perspective is a publicly available, machine learning API that can score text for toxicity. It is available for use in online platforms and communities to limit toxicity and promote civil dialogue. In this work, we adopt a human-centered approach to evaluating Perspective by investigating if human ratings of toxicity align with Perspective’s toxicity scores. We also test its transferability by making this comparison for comments from three platforms that have different commenting styles and moderation strategies: news websites, YouTube, and Twitter. Apart from toxicity, the main attribute, we collect participant ratings for three additional attributes: respectfulness, formality, and presence of stereotypes. While disrespect is part of how Perspective defines toxicity, formality and presence of stereotypes were included in the study to explore if they could be hidden/latent attributes that affect toxicity scores from Perspective. We analyzed how participant ratings for these additional attributes vary with respect to Perspective’s toxicity score for comments from each platform. We find that for high toxicity scores, Perspective strongly aligns with participant ratings of toxicity and disrespectfulness across all three platforms, providing weak evidence of its transferability. However, our evaluation also surfaced formality and presence of stereotypes as latent attributes that are unrecognized parts of Perspective’s scores. We discuss how and why this evaluation is “human-centered,” the importance of conducting such evaluations, and implications of these results for content moderation in social platforms.
Publisher
Association for Computing Machinery (ACM)
Reference63 articles.
1. Perspective API. [n.d.]. About the API. Retrieved November 3 2022 from https://developers.perspectiveapi.com/s/about-the-api-training-data?language=en_US.
2. Perspective API. [n.d.]. About the API—Attributes and Languages. Retrieved April 8 2021 https://developers.perspectiveapi.com/s/about-the-api-attributes-and-languages.
3. Perspective API. [n.d.]. About the API—Best Practices & Risks. Retrieved April 2 2021 from https://developers.perspectiveapi.com/s/about-the-api-best-practices-risks.
4. About the API–FAQs;Perspective API.;https://developers.perspectiveapi.com/s/about-th e-api-faqs
5. About the API–Model Cards;Perspective API.;https://developers.perspectiveapi.com/s/about-th e-api-model-cards?language=en_US&tabset-20254=2
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献