Abstract
AbstractStudents’ experience is used in empirical software engineering research as well as in software engineering education to group students in either homogeneous or heterogeneous groups. To do so, students are commonly asked to self-rate their experience, as self-rated experience has been shown to be a good predictor for performance in programming tasks. Another experience-related measurement is participants’ confidence (i.e., how confident is the person that their given answer is correct). Hence, self-rated experience and confidence are used as selector or control variables throughout empirical software engineering research and software engineering education. In this paper, we analyze data from several student experiments conducted in the past years to investigate whether self-rated experience and confidence are also good predictors for students’ performance in model comprehension tasks. Our results show that while students can somewhat assess the correctness of a particular answer to one concrete question regarding a conceptual model (i.e., their confidence), their overall self-rated experience does not correlate with their actual performance. Hence, the use of the commonly used measurement of self-rated experience as a selector or control variable must be considered unreliable for model comprehension tasks.
Funder
Universität Duisburg-Essen
Publisher
Springer Science and Business Media LLC
Cited by
5 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Women Performance in a Computer Science Program;2023 42nd IEEE International Conference of the Chilean Computer Science Society (SCCC);2023-10-23
2. Investigating Factors Influencing Students’ Assessment of Conceptual Models;Proceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering;2023-06-14
3. Aggregating N-fold Requirements Inspection Results;Proceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering;2023-06-14
4. Is Self-Rated Confidence a Predictor for Performance in Programming Comprehension Tasks?;APSIPA Transactions on Signal and Information Processing;2022
5. Model inspections in the engineering of collaborative cyber‐physical systems with instance‐level review diagrams;Journal of Software: Evolution and Process;2021-10-17