Perceived Need for Reform in Field-Wide Methods and the Teaching of Replication, Interpretation, and Transparency

Abstract

Despite discussion and institution of new reforms in psychology research, little is known about how much reform psychologists believe is still needed across various research practices and whether instructors are teaching students about replication and reform in their courses. To investigate these questions, we distributed questionnaires assessing perceived need for reform in psychology research and the teaching of replication and reform to instructors of undergraduate and graduate psychology courses across multiple listservs ( n = 328). Participants reported discussing topics related to replication and reform briefly in their courses and that moderate changes are still needed in psychology research. Topics were discussed more extensively in advanced vs. introductory courses, and in methods/statistics vs. content courses. Perceived need for reform and number of student researchers supervised/year correlated with teaching these issues, suggesting that those who believe more change is needed in psychology research and are more involved in shaping the next generation of psychology researchers are more likely to discuss replication and reform in their courses. Our questionnaires provide a preliminary tool to be further refined, validated, and applied in future research on knowledge and perceptions of problems in social science research and the impact of teaching these issues in the classroom.