Benefits and Challenges of Collaboration between Students and Conversational Generative Artificial Intelligence in Programming Learning: An Empirical Case Study

Abstract

The utilization of conversational generative artificial intelligence (Gen AI) in learning is often seen as a double-edged sword that may lead to superficial learning. We designed and implemented a programming course focusing on collaboration between students and Gen AI. This study explores the dynamics of such collaboration, focusing on students’ communication strategies with Gen AI, perceived benefits, and challenges encountered. Data were collected from class observations, surveys, final reports, dialogues between students and Gen AI, and semi-structured in-depth interviews. The results showed that effective collaboration between students and Gen AI could enhance students’ meta-cognitive and self-regulated learning skills and positively impact human-to-human communication. This study further revealed the difficulties and individual differences in collaborating with Gen AI on complex learning tasks. Overall, collaborating with Gen AI as a learning partner, rather than just a tool, enables sustainable and independent learning, beyond specific learning tasks at a given time.