Argumentation effect of a chatbot for ethical discussions about autonomous AI scenarios

Abstract

AbstractThis paper explores the potential of a German-language chatbot to engage users in argumentative dialogues on ethically sensitive topics. Utilizing an argumentative knowledge graph, the chatbot is equipped to engage in discussions on the ethical implications of autonomous AI systems in hypothetical future scenarios in the fields of medicine, law, and self-driving cars. In a study with 178 student participants, we investigated the chatbot’s argumentation effect—its ability to offer new perspectives, gain user acceptance, and broaden users’ viewpoints on complex issues. The results indicated a substantial argumentation effect, with 13–21% of participants shifting their opinions to more moderate stances after interacting with the chatbot. This shift demonstrates the system’s effectiveness in fostering informed discourse and increasing users’ understanding of AI ethics. While the chatbot was well-received, with users acknowledging the quality of its arguments, we identified opportunities for improvement in its argument recognition capabilities. Despite this, our results indicate the chatbot’s potential as an educational tool in engaging users with the ethical dimensions of AI technology and promoting informed discourse.