Affiliation:
1. University of Stuttgart, Institute of Software Engineering, Stuttgart, Germany
2. Chalmers and the University of Gothenburg, Dept. of Computer Science and Engineering, Gothenbug, Sweden
Abstract
A meaningful and deep understanding of the human aspects of software engineering (SE) requires psychological constructs to be considered. Psychology theory can facilitate the systematic and sound development as well as the adoption of instruments (e.g., psychological tests, questionnaires) to assess these constructs. In particular, to ensure high quality, the psychometric properties of instruments need evaluation. In this article, we provide an introduction to psychometric theory for the evaluation of measurement instruments for SE researchers. We present guidelines that enable using existing instruments and developing new ones adequately. We conducted a comprehensive review of the psychology literature framed by the Standards for Educational and Psychological Testing. We detail activities used when operationalizing new psychological constructs, such as item pooling, item review, pilot testing, item analysis, factor analysis, statistical property of items, reliability, validity, and fairness in testing and test bias. We provide an openly available example of a psychometric evaluation based on our guideline. We hope to encourage a culture change in SE research towards the adoption of established methods from psychology. To improve the quality of behavioral research in SE, studies focusing on introducing, validating, and then using psychometric instruments need to be more common.
Funder
Swedish Armed Forces
Swedish Defense Materiel Administration
Swedish Governmental Agency for Innovation Systems
Marianne and Marcus Wallenberg Foundation
Alexander von Humboldt (AvH) Foundation
Publisher
Association for Computing Machinery (ACM)
Reference146 articles.
1. Likert or Rasch? Nothing is more applicable than good theory
2. Anne Anastasi and Susana Urbina. 1997. Psychological Testing. Prentice Hall Upper Saddle River NJ. Anne Anastasi and Susana Urbina. 1997. Psychological Testing. Prentice Hall Upper Saddle River NJ.
3. Heterogeneous factor analysis models: A bayesian approach
Cited by
9 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献