The process of replication target selection in psychology: what to consider?

Author:

Pittelkow Merle-Marie1ORCID,Field Sarahanne M.2ORCID,Isager Peder M.3ORCID,van’t Veer Anna E.4ORCID,Anderson Thomas5ORCID,Cole Scott N.6,Dominik Tomáš7ORCID,Giner-Sorolla Roger8ORCID,Gok Sebahat9,Heyman Tom4ORCID,Jekel Marc10ORCID,Luke Timothy J.11ORCID,Mitchell David B.12,Peels Rik13ORCID,Pendrous Rosina1415ORCID,Sarrazin Samuel16,Schauer Jacob M.17ORCID,Specker Eva18ORCID,Tran Ulrich S.18ORCID,Vranka Marek A.19ORCID,Wicherts Jelte M.20ORCID,Yoshimura Naoto2122ORCID,Zwaan Rolf A.23ORCID,van Ravenzwaaij Don1ORCID

Affiliation:

1. Department of Psychometrics and Statistics, Rijksuniversiteit Groningen, Groningen, The Netherlands

2. Centre of Science and Technology Studies, Leiden University, Leiden, the Netherlands

3. Oslo New University College, Oslo, Norway

4. Methodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, the Netherlands

5. Department of Psychology, University of Toronto, Toronto, Canada

6. School of Education, Language and Psychology, York St John University, York, UK

7. Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, CA, USA

8. School of Psychology, University of Kent, Canterbury, UK

9. Program in Cognitive Science, Department of Instructional Systems Technology, Indiana University, Bloomington, IN, USA

10. Social Psychology, University of Cologne, Cologne, Germany

11. Department of Psychology, University of Gothenburg, Gothenburg, Sweden

12. WellStar College of Health and Human Services, Kennesaw State University, Kennesaw, GA, USA

13. Philosophy Department and the Faculty of Religion and Theology, Vrije Universiteit, Amsterdam, The Netherlands

14. Centre for Contextual Behavioural Science, School of Psychology, University of Chester, Chester, UK

15. Institute of Applied Health Research, University of Birmingham, Birmingham, UK

16. Maison de santé pluridisciplinaire Pasteur, Chevilly-Larue, France

17. Department of Preventive Medicine - Division of Biostatistics, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA

18. Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria

19. Faculty of Social Sciences, Charles University, Prague, Czech Republic

20. Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands

21. Research Organization of Open Innovation and Collaboration, Ritsumeikan University, Osaka, Japan

22. Research Fellow of the Japan Society for the Promotion of Science, Erasmus University Rotterdam, Rotterdam, The Netherlands

23. Department of Psychology, Education, and Child Studies, Erasmus University Rotterdam, Rotterdam, The Netherlands

Abstract

Increased execution of replication studies contributes to the effort to restore credibility of empirical research. However, a second generation of problems arises: the number of potential replication targets is at a serious mismatch with available resources. Given limited resources, replication target selection should be well-justified, systematic and transparently communicated. At present the discussion on what to consider when selecting a replication target is limited to theoretical discussion, self-reported justifications and a few formalized suggestions. In this Registered Report, we proposed a study involving the scientific community to create a list of considerations for consultation when selecting a replication target in psychology. We employed a modified Delphi approach. First, we constructed a preliminary list of considerations. Second, we surveyed psychologists who previously selected a replication target with regards to their considerations. Third, we incorporated the results into the preliminary list of considerations and sent the updated list to a group of individuals knowledgeable about concerns regarding replication target selection. Over the course of several rounds, we established consensus regarding what to consider when selecting a replication target. The resulting checklist can be used for transparently communicating the rationale for selecting studies for replication.

Funder

NWO

Publisher

The Royal Society

Subject

Multidisciplinary

Reference62 articles.

1. Editors’ Introduction to the Special Section on Replicability in Psychological Science

2. Dutch agency launches first grants programme dedicated to replication;Baker M;Nature,2016

3. Why Most Published Research Findings Are False

4. Levelt Committee Noort Committee Drenth Committee. 2012 Flawed science: the fraudulent research practices of social psychologist Diederik Stapel. Technical report.

5. An Agenda for Purely Confirmatory Research

Cited by 1 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3