Replicability, Robustness, and Reproducibility in Psychological Science

Author:

Nosek Brian A.12,Hardwicke Tom E.3,Moshontz Hannah4,Allard Aurélien5,Corker Katherine S.6,Dreber Anna7,Fidler Fiona8,Hilgard Joe9,Kline Struhl Melissa2,Nuijten Michèle B.10,Rohrer Julia M.11,Romero Felipe12,Scheel Anne M.13,Scherer Laura D.14,Schönbrodt Felix D.15,Vazire Simine16

Affiliation:

1. Department of Psychology, University of Virginia, Charlottesville, Virginia 22904, USA;

2. Center for Open Science, Charlottesville, Virginia 22903, USA

3. Department of Psychology, University of Amsterdam, 1012 ZA Amsterdam, The Netherlands

4. Addiction Research Center, University of Wisconsin–Madison, Madison, Wisconsin 53706, USA

5. Department of Psychology, University of California, Davis, California 95616, USA

6. Psychology Department, Grand Valley State University, Allendale, Michigan 49401, USA

7. Department of Economics, Stockholm School of Economics, 113 83 Stockholm, Sweden

8. School of Biosciences, University of Melbourne, Parkville VIC 3010, Australia

9. Department of Psychology, Illinois State University, Normal, Illinois 61790, USA

10. Meta-Research Center, Tilburg University, 5037 AB Tilburg, The Netherlands

11. Department of Psychology, Leipzig University, 04109 Leipzig, Germany

12. Department of Theoretical Philosophy, University of Groningen, 9712 CP Groningen, The Netherlands

13. Department of Industrial Engineering and Innovation Sciences, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands

14. University of Colorado Anschutz Medical Campus, Aurora, Colorado 80045, USA

15. Department of Psychology, Ludwig Maximilian University of Munich, 80539 Munich, Germany

16. School of Psychological Sciences, University of Melbourne, Parkville VIC 3052, Australia

Abstract

Replication—an important, uncommon, and misunderstood practice—is gaining appreciation in psychology. Achieving replicability is important for making research progress. If findings are not replicable, then prediction and theory development are stifled. If findings are replicable, then interrogation of their meaning and validity can advance knowledge. Assessing replicability can be productive for generating and testing hypotheses by actively confronting current understandings to identify weaknesses and spur innovation. For psychology, the 2010s might be characterized as a decade of active confrontation. Systematic and multi-site replication projects assessed current understandings and observed surprising failures to replicate many published findings. Replication efforts highlighted sociocultural challenges such as disincentives to conduct replications and a tendency to frame replication as a personal attack rather than a healthy scientific practice, and they raised awareness that replication contributes to self-correction. Nevertheless, innovation in doing and understanding replication and its cousins, reproducibility and robustness, has positioned psychology to improve research practices and accelerate progress.

Publisher

Annual Reviews

Subject

General Psychology

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3