Unlocking Educational Potential: Exploring Students’ Satisfaction and Sustainable Engagement with ChatGPT Using the ECM Model

Abstract

Aim/Purpose: The main goal of this study is to investigate the factors affecting students’ satisfaction and continuous usage of ChatGPT in an educational context, using the Expectation-Confirmation Model (ECM) as the theoretical framework. Specifically, this investigation focuses on identifying how user expectations, perceived usefulness, and satisfaction influence the continuous usage of ChatGPT in education. Background: ChatGPT is an AI-based chatbot that can generate natural language and support multi-turn dialogue. ChatGPT can be used in education for various purposes, such as academic writing, language translating, coding assistance, and information searching. Research indicates that ChatGPT is highly beneficial for students. Specifically, it aids in time-saving by synthesizing information across diverse fields and offers feedback tailored to individual learning needs and progress. Moreover, it enhances learning experiences through a personalized learning process, as well as aids in the translation of learning materials into different languages for improved accessibility. Despite the potential of ChatGPT in education, there remains a gap in understanding the determinants of user satisfaction and continuous usage. Therefore, this study was conducted to bridge this gap by assessing the impact of expectation confirmation, perceived usefulness, and satisfaction on continuous usage of ChatGPT. Methodology: This research employed a quantitative approach, which utilized a five-point Likert scale questionnaire to measure four variables with a total of 14 items. Data were collected from 435 students from eight Vietnamese universities through non-probability convenience sampling. The internal consistency of the questionnaire was examined using Cronbach’s alpha. Four-factors Confirmatory Factor Analysis (CFA) and Structural Equation Modeling (SEM) were then employed through IBM SPSS 26 and AMOS 24 to assess the proposed model and hypotheses, allowing for a comprehensive examination of the relationships between 4 variables: perceived usefulness, expectation confirmation, satisfaction, and continuous usage. Contribution: This paper contributes to the literature on ChatGPT in education by identifying how expectation confirmation and perceived usefulness affect students’ satisfaction and their intention to continue using ChatGPT in their learning. This study also has practical implications for educators and students for applying ChatGPT in their learning and teaching. It provides recommendations for effective use of ChatGPT in education. Findings: The study’s results show that students with greater expectations, either met or surpassed by ChatGPT, perceived the tool as more beneficial and satisfying for their needs. Additionally, students who perceived ChatGPT as useful and valuable for their learning goals were more inclined to continue to use it. Furthermore, the findings indicate that higher satisfaction with the tool was associated with a greater likelihood of continuous usage. Nevertheless, the results did not reveal a significant relationship between perceived usefulness and satisfaction regarding ChatGPT. This implies that perceiving ChatGPT as useful does not guarantee satisfaction. This finding may be attributed to various factors influencing student satisfaction, such as price value, using habit, facilitating conditions, trust, reliability, and quality. Recommendations for Practitioners: Educators and students should consider the findings of this study to make informed decisions about the use of ChatGPT in educational settings, emphasizing the importance of managing users’ expectation confirmation and ensuring perceived usefulness and satisfaction on continuous usage. Recommendation for Researchers: Researchers can use the findings of this study as a foundation for exploring a deeper understanding of user expectation confirmation and the factors influencing perceived usefulness and satisfaction with ChatGPT in diverse educational settings. Impact on Society: This study contributes to the broader field of the application of AI technologies in education, potentially reshaping the dynamics of interaction between students and educators with AI technologies for educational purposes. Its contributions have the potential to elevate the overall quality of education by promoting the appropriate and effective use of AI technologies. Future Research: Future research should investigate the roles of ChatGPT in education more deeply and explore its long-term effects on both learners and educators. This includes conducting comparative studies to evaluate the efficacy and advantages of ChatGPT-assisted learning in comparison to traditional teaching methods. Additionally, there is a crucial need to assess the broader impact of ChatGPT on students’ academic performance, cognitive development, and critical thinking skills.