You Know What I Meme: Enhancing People's Understanding and Awareness of Hateful Memes Using Crowdsourced Explanations-Reference-Cited by-同舟云学术

You Know What I Meme: Enhancing People's Understanding and Awareness of Hateful Memes Using Crowdsourced Explanations

Published:2023-04-14 Issue:CSCW1 Volume:7 Page:1-27
ISSN:2573-0142
Container-title:Proceedings of the ACM on Human-Computer Interaction
language:en
Short-container-title:Proc. ACM Hum.-Comput. Interact.

Author:

Bi Nanyi¹^ORCID,Huang Yi-Ching (Janet)²^ORCID,Han Chao-Chun¹^ORCID,Hsu Jane Yung-jen¹^ORCID

Affiliation:

1. National Taiwan University, Taipei, Taiwan Roc

2. Eindhoven University of Technology, Eindhoven, Netherlands

Abstract

Good explanations help people understand hateful memes and mitigate sharing. While AI-enabled automatic detection has proliferated, we argue that quality-controlled crowdsourcing can be an effective strategy to offer good explanations for hateful memes. This paper proposes a Generate-Annotate-Revise workflow to crowdsource explanations and presents the results from two user studies. Study 1 evaluated the objective quality of the explanation with three measurements: detailedness, completeness, and accuracy, and suggested that the proposed workflow generated higher quality explanations than the ones from a single-stage workflow without quality control. Study 2 used an online experiment to examine how different explanations affect users' perception. The results from 127 participants demonstrated that people without prior cultural knowledge gained significant perceived understanding and awareness of hateful memes when presented with explanations generated by the proposed multi-stage workflow as opposed to single-stage or machine-generated explanations.

Funder

National Science and Technology Council of Taiwan

Publisher

Association for Computing Machinery (ACM)

Subject

Computer Networks and Communications,Human-Computer Interaction,Social Sciences (miscellaneous)

Link

https://dl.acm.org/doi/pdf/10.1145/3579593

Reference87 articles.

1. Amina Adadi and Mohammed Berrada . 2018. Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI) . IEEE Access ( 2018 ), 52138--52160. https://doi.org/10.1109/ACCESS.2018.2870052 10.1109/ACCESS.2018.2870052 Amina Adadi and Mohammed Berrada. 2018. Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI). IEEE Access (2018), 52138--52160. https://doi.org/10.1109/ACCESS.2018.2870052

2. Icek Ajzen . 1991. The theory of planned behavior. Organizational Behavior and Human Decision Processes ( 1991 ), 179--211. Icek Ajzen. 1991. The theory of planned behavior. Organizational Behavior and Human Decision Processes (1991), 179--211.

3. Mohammad Allahbakhsh , Boualem Benatallah , Aleksandar Ignjatovic , Hamid Reza Motahari-Nezhad , Elisa Bertino, and Schahram Dustdar. 2013 . Quality control in crowdsourcing systems: Issues and directions. IEEE Internet Computing ( 2013), 76--81. Mohammad Allahbakhsh, Boualem Benatallah, Aleksandar Ignjatovic, Hamid Reza Motahari-Nezhad, Elisa Bertino, and Schahram Dustdar. 2013. Quality control in crowdsourcing systems: Issues and directions. IEEE Internet Computing (2013), 76--81.

4. Evaluating saliency map explanations for convolutional neural networks

5. Fabienne H Baider , Stavros Assimakopoulos , and Sharon Louise Millar . 2017. Hate speech in the EU and the CONTACT project. Online Hate Speech in the European Union: A Discourse-Analytic Perspective, eds S. Assimakopoulos , FH Baider, and S. Millar ( Cham : Springer) ( 2017 ), 1--6. Fabienne H Baider, Stavros Assimakopoulos, and Sharon Louise Millar. 2017. Hate speech in the EU and the CONTACT project. Online Hate Speech in the European Union: A Discourse-Analytic Perspective, eds S. Assimakopoulos, FH Baider, and S. Millar (Cham: Springer) (2017), 1--6.