Affiliation:
1. Institute of Software Technology, University of Stuttgart, Stuttgart, Germany
Abstract
Background
Assessing a software engineer’s ability to solve algorithmic programming tasks has been an essential part of technical interviews at some of the most successful technology companies for several years now. We do not know to what extent individual characteristics, such as personality or programming experience, predict the performance in such tasks. Decision makers’ unawareness of possible predictor variables has the potential to bias hiring decisions which can result in expensive false negatives as well as in the unintended exclusion of software engineers with actually desirable characteristics.
Methods
We conducted an exploratory quantitative study with 32 software engineering students to develop an empirical theory on which individual characteristics predict the performance in solving coding challenges. We developed our theory based on an established taxonomy framework by Gregor (2006).
Results
Our findings show that the better coding challenge solvers also have better exam grades and more programming experience. Furthermore, conscientious as well as sad software engineers performed worse in our study. We make the theory available in this paper for empirical testing.
Discussion
The theory raises awareness to the influence of individual characteristics on the outcome of technical interviews. Should the theory find empirical support in future studies, hiring costs could be reduced by selecting appropriate criteria for preselecting candidates for on-site interviews and potential bias in hiring decisions could be reduced by taking suitable measures.
Funder
Alexander von Humboldt (AvH) Foundation
Reference78 articles.
1. What do developers use the crowd for? A study using stack overflow;Abdalkareem;IEEE Software,2017
2. How do personality, team processes and task characteristics relate to job satisfaction and software quality?;Acuña;Information and Software Technology,2009
3. ICPC history—the 2017 world champions;Baylor University,2017
4. Dazed: measuring the cognitive load of solving technical interview problems at the whiteboard;Behroozi,2018
5. Software engineering group work: personality, patterns and performance;Bell,2009
Cited by
12 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Implementation and Evaluation of Technical Interview Preparation Activities in a Data Structures and Algorithms Course;Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1;2023-03-02
2. Anchoring code understandability evaluations through task descriptions;Proceedings of the 30th IEEE/ACM International Conference on Program Comprehension;2022-05-16
3. Metrics to quantify software developer experience;Proceedings of the 37th ACM/SIGAPP Symposium on Applied Computing;2022-04-25
4. Psychometrics in Behavioral Software Engineering: A Methodological Introduction with Guidelines;ACM Transactions on Software Engineering and Methodology;2022-01-31
5. Ready to Work: Evaluating the Role of Community Cultural Wealth during the Hiring Process in Computing;2021 Conference on Research in Equitable and Sustained Participation in Engineering, Computing, and Technology (RESPECT);2021-05-23