Affiliation:
1. Abilene Christian University, USA
2. The University of Auckland, New Zealand
3. University College Dublin, Ireland
Abstract
Recent developments in deep learning have resulted in code-generation models that produce source code from natural language and code-based prompts with high accuracy. This is likely to have profound effects in the classroom, where novices learning to code can now use free tools to automatically suggest solutions to programming exercises and assignments. However, little is currently known about how novices interact with these tools in practice. We present the first study that observes students at the introductory level using one such code auto-generating tool, Github Copilot, on a typical introductory programming (CS1) assignment. Through observations and interviews we explore student perceptions of the benefits and pitfalls of this technology for learning, present new observed interaction patterns, and discuss cognitive and metacognitive difficulties faced by students. We consider design implications of these findings, specifically in terms of how tools like Copilot can better support and scaffold the novice programming experience.
Publisher
Association for Computing Machinery (ACM)
Subject
Human-Computer Interaction
Reference109 articles.
1. Trends and Trajectories for Explainable, Accountable and Intelligible Systems
2. Beyond usability
3. Plagiarism in Programming Assessments
4. Concise Graphical Representations of Student Effort on Weekly Many Small Programs
5. Desai Ankur and Deo Atul. 2022. Introducing Amazon CodeWhisperer the ML-powered Coding Companion. Retrieved from https://aws.amazon.com/blogs/machine-learning/introducing-amazon-codewhisperer-the-ml-powered-coding-companion/
Cited by
11 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Next-Step Hint Generation for Introductory Programming Using Large Language Models;Proceedings of the 26th Australasian Computing Education Conference;2024-01-29
2. Patterns of Student Help-Seeking When Using a Large Language Model-Powered Programming Assistant;Proceedings of the 26th Australasian Computing Education Conference;2024-01-29
3. The Effects of Generative AI on Computing Students’ Help-Seeking Preferences;Proceedings of the 26th Australasian Computing Education Conference;2024-01-29
4. Computing Education in the Era of Generative AI;Communications of the ACM;2024-01-25
5. Incorporating Generative AI into Software Development Education;Proceedings of the 8th Conference on Computing Education Practice;2024-01-05