Grounded Copilot: How Programmers Interact with Code-Generating Models-Reference-Cited by-同舟云学术

Grounded Copilot: How Programmers Interact with Code-Generating Models

Published:2023-04-06 Issue:OOPSLA1 Volume:7 Page:85-111
ISSN:2475-1421
Container-title:Proceedings of the ACM on Programming Languages
language:en
Short-container-title:Proc. ACM Program. Lang.

Author:

Barke Shraddha¹^ORCID,James Michael B.¹^ORCID,Polikarpova Nadia¹^ORCID

Affiliation:

1. University of California at San Diego, USA

Abstract

Powered by recent advances in code-generating models, AI assistants like Github Copilot promise to change the face of programming forever. But what is this new face of programming? We present the first grounded theory analysis of how programmers interact with Copilot, based on observing 20 participants—with a range of prior experience using the assistant—as they solve diverse programming tasks across four languages. Our main finding is that interactions with programming assistants are bimodal : in acceleration mode , the programmer knows what to do next and uses Copilot to get there faster; in exploration mode , the programmer is unsure how to proceed and uses Copilot to explore their options. Based on our theory, we provide recommendations for improving the usability of future AI programming assistants.

Publisher

Association for Computing Machinery (ACM)

Subject

Safety, Risk, Reliability and Quality,Software

Link

https://dl.acm.org/doi/pdf/10.1145/3586030

Reference67 articles.

1. Matej Balog , Alexander L Gaunt , Marc Brockschmidt , Sebastian Nowozin , and Daniel Tarlow . 2016 . Deepcoder: Learning to write programs. arXiv preprint arXiv:1611.01989. Matej Balog, Alexander L Gaunt, Marc Brockschmidt, Sebastian Nowozin, and Daniel Tarlow. 2016. Deepcoder: Learning to write programs. arXiv preprint arXiv:1611.01989.

2. Mohammad Bavarian Heewoo Jun Nikolas Tezak John Schulman Christine McLeavey Jerry Tworek and Mark Chen. 2022. Efficient Training of Language Models to Fill in the Middle. Jul https://doi.org/10.48550/arXiv.2207.14255 arXiv:2207.14255 [cs]. 10.48550/arXiv.2207.14255

3. Mohammad Bavarian Heewoo Jun Nikolas Tezak John Schulman Christine McLeavey Jerry Tworek and Mark Chen. 2022. Efficient Training of Language Models to Fill in the Middle. Jul https://doi.org/10.48550/arXiv.2207.14255 arXiv:2207.14255 [cs].

4. Tom Brown , Benjamin Mann , Nick Ryder , Melanie Subbiah , Jared D Kaplan , Prafulla Dhariwal , Arvind Neelakantan , Pranav Shyam , Girish Sastry , and Amanda Askell . 2020. Language models are few-shot learners. Advances in neural information processing systems, 33 ( 2020 ), 1877–1901. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, and Amanda Askell. 2020. Language models are few-shot learners. Advances in neural information processing systems, 33 (2020), 1877–1901.

Cited by 91 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Exploring the problems, their causes and solutions of AI pair programming: A study on GitHub and Stack Overflow;Journal of Systems and Software;2025-01

2. Software engineering education in the era of conversational AI: current trends and future directions;Frontiers in Artificial Intelligence;2024-08-29

3. Term Search in Rust;Proceedings of the 9th ACM SIGPLAN International Workshop on Type-Driven Development;2024-08-28

4. Assessing the Use of GitHub Copilot on Students of Engineering of Information Systems;International Journal of Software Engineering and Knowledge Engineering;2024-08-24

5. Reasoning and Planning with Large Language Models in Code Development;Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining;2024-08-24