Studying Developer Eye Movements to Measure Cognitive Workload and Visual Effort for Expertise Assessment-Reference-Cited by-同舟云学术

Studying Developer Eye Movements to Measure Cognitive Workload and Visual Effort for Expertise Assessment

Published:2023-05-17 Issue:ETRA Volume:7 Page:1-18
ISSN:2573-0142
Container-title:Proceedings of the ACM on Human-Computer Interaction
language:en
Short-container-title:Proc. ACM Hum.-Comput. Interact.

Author:

Aljehane Salwa D.¹,Sharif Bonita²^ORCID,Maletic Jonathan I.³^ORCID

Affiliation:

1. University of Tabuk, Tabuk, Saudi Arabia

2. University of Nebraska - Lincoln, Lincoln, NE, USA

3. Kent State University, Kent, OH, USA

Abstract

Eye movement data provides valuable insights that help test hypotheses about a software developer's comprehension process. The pupillary response is successfully used to assess mental processing effort and attentional focus. Relatively little is known about the impact of expertise level in cognitive effort during programming tasks. This paper presents a quantitative analysis that compares the eye movements of 207 experts and novices collected while solving program comprehension tasks. The goal is to examine changes of developers' eye movement metrics in accordance with their expertise. The results indicate significant increase in pupil size with the novice group compared to the experts, explaining higher cognitive effort for novices. Novices also tend to have a significant number of fixations and higher gaze time compared to experts when they comprehend code. Moreover, a correlation study found that programming experience is still a powerful indicator when explaining expertise in this eye-tracking dataset among other expertise variables.

Funder

National Science Foundation

Publisher

Association for Computing Machinery (ACM)

Subject

Computer Networks and Communications,Human-Computer Interaction,Social Sciences (miscellaneous)

Link

https://dl.acm.org/doi/pdf/10.1145/3591135

Reference68 articles.

1. Using developer eye movements to externalize the mental model used in code summarization tasks

2. N. J. Abid , B. Sharif , N. Dragan , H. Alrasheed , and J. I. Maletic . 2019b . Developer Reading Behavior While Summarizing Java Methods: Size and Context Matters. In 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE). 384--395 . https://doi.org/10.1109/ICSE. 2019 .00052 ISSN: 1558--1225. 10.1109/ICSE.2019.00052 N. J. Abid, B. Sharif, N. Dragan, H. Alrasheed, and J. I. Maletic. 2019b. Developer Reading Behavior While Summarizing Java Methods: Size and Context Matters. In 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE). 384--395. https://doi.org/10.1109/ICSE.2019.00052 ISSN: 1558--1225.

3. Determining Differences in Reading Behavior Between Experts and Novices by Investigating Eye Movement on Source Code Constructs During a Bug Fixing Task

4. Salwa Aljehani and Bonita Sharif. 2023. Studying Developer Eye Movements to Measure Cognitive Workload and Visual Effort for Expertise Assessment - Dataset. https://doi.org/10.17605/OSF.IO/RSQDX 10.17605/OSF.IO

5. Salwa Aljehani and Bonita Sharif. 2023. Studying Developer Eye Movements to Measure Cognitive Workload and Visual Effort for Expertise Assessment - Dataset. https://doi.org/10.17605/OSF.IO/RSQDX

Cited by 4 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. An integrated framework for eye tracking-assisted task capability recognition of air traffic controllers with machine learning;Advanced Engineering Informatics;2024-10

2. On Eye Tracking in Software Engineering;SN Computer Science;2024-07-26

3. Attention Dynamics in Programming: Eye Gaze Patterns of High- vs. Low-Ability Novice Coders;Proceedings of the 2024 Symposium on Eye Tracking Research and Applications;2024-06-04

4. Evaluating the Feasibility of Predicting Information Relevance During Sensemaking with Eye Gaze Data;2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR);2023-10-16