Affiliation:
1. Department of Computer Science, American University, Washington, DC 20016, USA
2. Department of Linguistics, University of Pittsburgh, Pittsburgh, PA 15260, USA
Abstract
Detection of AI-generated content is a crucially important task considering the increasing attention towards AI tools, such as ChatGPT, and the raised concerns with regard to academic integrity. Existing text classification approaches, including neural-network-based and feature-based methods, are mostly tailored for English data, and they are typically limited to a supervised learning setting. Although one-class learning methods are more suitable for classification tasks, their effectiveness in essay detection is still unknown. In this paper, this gap is explored by adopting linguistic features and one-class learning models for AI-generated essay detection. Detection performance of different models is assessed in different settings, where positively labeled data, i.e., AI-generated essays, are unavailable for model training. Results with two datasets containing essays in L2 English and L2 Spanish show that it is feasible to accurately detect AI-generated essays. The analysis reveals which models and which sets of linguistic features are more powerful than others in the detection task.
Subject
Fluid Flow and Transfer Processes,Computer Science Applications,Process Chemistry and Technology,General Engineering,Instrumentation,General Materials Science
Reference53 articles.
1. Sallam, M. (2023). ChatGPT utility in healthcare education, research, and practice: Systematic review on the promising perspectives and valid concerns. Healthcare, 11.
2. Chatting about ChatGPT: How may AI and GPT impact academia and libraries?;Lund;Libr. Hi Tech News,2023
3. A conversation on artificial intelligence, chatbots, and plagiarism in higher education;King;Cell. Mol. Bioeng.,2023
4. The World Wide Web for academic purposes: Old study skills for new?;Slaouti;Engl. Specif. Purp.,2002
5. Writing in an electronic age: A case study of L2 composing processes;Stapleton;J. Engl. Acad. Purp.,2010
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献