Affiliation:
1. Department of Psychology, George Mason University, Fairfax, VA, USA
Abstract
Natural language processing (NLP) techniques are becoming increasingly popular in industrial and organizational psychology. One promising area for NLP-based applications is scale development; yet, while many possibilities exist, so far these applications have been restricted—mainly focusing on automated item generation. The current research expands this potential by illustrating an NLP-based approach to content analysis, which manually categorizes scale items by their measured constructs. In NLP, content analysis is performed as a text classification task whereby a model is trained to automatically assign scale items to the construct that they measure. Here, we present an approach to text classification—using state-of-the-art transformer models—that builds upon past approaches. We begin by introducing transformer models and their advantages over alternative methods. Next, we illustrate how to train a transformer to content analyze Big Five personality items. Then, we compare the models trained to human raters, finding that transformer models outperform human raters and several alternative models. Finally, we present practical considerations, limitations, and future research directions.
Subject
Management of Technology and Innovation,Strategy and Management,General Decision Sciences
Reference141 articles.
1. Adhikari A., Ram A., Tang R., Lin J. (2019). DocBERT: Bert for document classification. ArXiv:1904.08398 [Cs]. http://arxiv.org/abs/1904.08398
2. Alberti C., Lee K., Collins M. (2019). A BERT baseline for the natural questions. ArXiv:1901.08634 [Cs]. http://arxiv.org/abs/1901.08634
3. Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validities.
4. A defence of the lexical approach to the study of personality structure
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献