ChatGPT and the Writing of Philosophical Essays

Abstract

Text-generative AI-systems have become important semantic agents with ChatGPT. We conducted a series of experiments to learn what teachers’ conceptions of text-generative AI are in relation to philosophical texts. In our main experiment, using mixed methods, we had twenty-four high school students write philosophical essays, which we then randomized to essays with the same command from ChatGPT. We had ten prospective teachers assess these essays. They were able to tell whether it was an AI or student essay with 78.7 percent accuracy, which is better than the Open AI Classifier. Interestingly, however, they used criteria like argumentative and logical flawlessness and neutrality. We concluded from this that they are using an inverted Turing test and are no longer looking for rationality in machines but for irrationality in humans.