The Thrills and Chills of ChatGPT: Implications for Assessments in Undergraduate Dental Education

Abstract

Background and Purpose: Open-source Artificial intelligence (AI) applications are fast transforming access to information and allow students to prepare assignments and offer quite accurate responses to a wide range of exam questions which are routinely used in assessments of students across the board including undergraduate dental students. This study aims to evaluate the performance ChatGPT, an AI-based application, on a wide range of dental assessments and discusses the implications for undergraduate dental education. Methods: This was an exploratory study investigating the accuracy of ChatGPT to attempt a range of recognized assessments in undergraduate dental curricula. ChatGPT was used to attempt ten items based on each of the five commonly used question formats including single-best answer (SBA) multiple-choice questions (MCQs); short answer questions (SAQs); short essay questions (SEQs); True/False questions and fill in the blanks items. In addition, ChatGPT was used to generate reflective reports based on multisource feedback (MSF); research methodology; critical appraisal of the literature. Results: ChatGPT application provided accurate responses to majority of knowledge-based assessments based on MCQs, SAQs, SEQs, Tue/False and fill in the blanks items. However, it was only able to answer text-based questions and did not allow processing of questions based on images. Responses generated to written assignments were also of good quality apart from those for critical appraisal of literature. Word count was the key limitation observed in outputs by ChatGPT as it was only able to produce reports limited to approximately 650 words. Conclusion: Notwithstanding their current limitations, AI-based applications have the potential to revolutionize virtual learning. Instead of treating it as a threat, dental educators need to adapt teaching and assessments in dental education to the benefits of the learners whilst mitigating against dishonest use of AI-based applications.