Affiliation:
1. Department of Information Science, Cornell University, Ithaca, NY 14850
2. Jacobs Institute, Cornell Tech, New York, NY 10044
3. Department of Communication, Stanford University, Stanford, CA 94305
Abstract
Human communication is increasingly intermixed with language generated by AI. Across chat, email, and social media, AI systems suggest words, complete sentences, or produce entire conversations. AI-generated language is often not identified as such but presented as language written by humans, raising concerns about novel forms of deception and manipulation. Here, we study how humans discern whether verbal self-presentations, one of the most personal and consequential forms of language, were generated by AI. In six experiments, participants (N = 4,600) were unable to detect self-presentations generated by state-of-the-art AI language models in professional, hospitality, and dating contexts. A computational analysis of language features shows that human judgments of AI-generated language are hindered by intuitive but flawed heuristics such as associating first-person pronouns, use of contractions, or family topics with human-written language. We experimentally demonstrate that these heuristics make human judgment of AI-generated language predictable and manipulable, allowing AI systems to produce text perceived as “more human than human.” We discuss solutions, such as AI accents, to reduce the deceptive potential of language generated by AI, limiting the subversion of human intuition.
Funder
National Science Foundation
Publisher
Proceedings of the National Academy of Sciences
Reference50 articles.
1. Language models are few-shot learners;Brown T.;Adv. Neural Inf. Process. Syst.,2020
2. Attention is all you need;Vaswani A.;Adv. Neural Inf. Process. Syst.,2017
3. S. Biderman E. Raff Neural language models are effective plagiarists. arXiv [Preprint] (2022). https://doi.org/10.48550/arXiv.2201.07406 (Accessed 2 May 2022).
4. R. Bommasani On the opportunities and risks of foundation models. arXiv [Preprint] (2021). https://doi.org/10.48550/arXiv.2108.07258 (Accessed 12 August 2022).
5. N. A. Cooke, Fake News and Alternative Facts: Information Literacy in a Post-Truth Era (American Library Association, 2018).
Cited by
66 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献