“Transforming” Personality Scale Development: Illustrating the Potential of State-of-the-Art Natural Language Processing

Author:

Fyffe Shea1ORCID,Lee Philseok1ORCID,Kaplan Seth1

Affiliation:

1. Department of Psychology, George Mason University, Fairfax, VA, USA

Abstract

Natural language processing (NLP) techniques are becoming increasingly popular in industrial and organizational psychology. One promising area for NLP-based applications is scale development; yet, while many possibilities exist, so far these applications have been restricted—mainly focusing on automated item generation. The current research expands this potential by illustrating an NLP-based approach to content analysis, which manually categorizes scale items by their measured constructs. In NLP, content analysis is performed as a text classification task whereby a model is trained to automatically assign scale items to the construct that they measure. Here, we present an approach to text classification—using state-of-the-art transformer models—that builds upon past approaches. We begin by introducing transformer models and their advantages over alternative methods. Next, we illustrate how to train a transformer to content analyze Big Five personality items. Then, we compare the models trained to human raters, finding that transformer models outperform human raters and several alternative models. Finally, we present practical considerations, limitations, and future research directions.

Publisher

SAGE Publications

Subject

Management of Technology and Innovation,Strategy and Management,General Decision Sciences

Reference141 articles.

1. Adhikari A., Ram A., Tang R., Lin J. (2019). DocBERT: Bert for document classification. ArXiv:1904.08398 [Cs]. http://arxiv.org/abs/1904.08398

2. Alberti C., Lee K., Collins M. (2019). A BERT baseline for the natural questions. ArXiv:1901.08634 [Cs]. http://arxiv.org/abs/1901.08634

3. Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validities.

4. A defence of the lexical approach to the study of personality structure

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3