Commentaries and Rejoinder on-Reference-Cited by-同舟云学术

Commentaries and Rejoinder on

Published:2014-05-01 Issue:4 Volume:45 Page:299-311
ISSN:1864-9335
Container-title:Social Psychology
language:en
Short-container-title:Social Psychology

Author:

Monin Benoît¹,Oppenheimer Daniel M.²,Ferguson Melissa J.³⁴,Carter Travis J.⁵⁴,Hassin Ran R.⁵⁴,Crisp Richard J.⁶,Miles Eleanor⁷,Husnu Shenel⁸,Schwarz Norbert⁹,Strack Fritz¹⁰,Klein Richard A.¹¹,Ratliff Kate A.¹¹,Vianello Michelangelo¹²,Adams Reginald B.¹³,Bahník Štěpán¹⁴,Bernstein Michael J.¹⁵,Bocian Konrad¹⁶,Brandt Mark J.¹⁷,Brooks Beach¹¹,Chloe Brumbaugh Claudia¹⁸,Cemalcilar Zeynep¹⁹,Chandler Jesse²⁰²¹,Cheong Winnee²²,Davis William E.²³,Devos Thierry²⁴,Eisner Matthew²⁰,Frankowska Natalia¹⁶,Furrow David²⁵,Maria Galliani Elisa¹²,Hasselman Fred²⁶²⁷,Hicks Joshua A.²³,Hovermale James F.²⁸,Jane Hunt S.²⁹,Huntsinger Jeffrey R.³⁰,IJzerman Hans¹⁷,John Melissa-Sue³¹,Joy-Gaba Jennifer A.²⁸,Barry Kappes Heather³²,Krueger Lacy E.²⁹,Kurtz Jaime³³,Levitan Carmel A.³⁴,Mallett Robyn K.³⁵,Morris Wendy L.³⁶,Nelson Anthony J.¹³,Nier Jason A.³⁷,Packard Grant³⁸,Pilati Ronaldo³⁹,Rutchick Abraham M.⁴⁰,Schmidt Kathleen³⁵,Skorinko Jeanine L.³¹,Smith Robert⁴¹,Steiner Troy G.¹³,Storbeck Justin¹⁸,Van Swol Lyn M.⁴²,Thompson Donna²⁵,van ‘t Veer A. E.¹⁷¹⁷,Ann Vaughn Leigh⁴³,Vranka Marek⁴⁴,Wichman Aaron L.⁴⁵,Woodzicka Julie A.⁴⁶,Nosek Brian A.³⁵⁴⁷,Kahneman Daniel⁴⁸

Affiliation:

1. Stanford University, Stanford, CA, USA

2. University of California, Los Angeles, CA, USA

3. Cornell University, Ithaca, NY, USA

4. Hebrew University, Jerusalem, Israel

5. Colby College, Waterville, WE, USA

6. University of Sheffield, UK

7. University of Sussex, UK

8. Eastern Mediterranean University, Cyprus

9. University of Southern California, Los Angeles, CA, USA

10. Universität Würzburg, Germany

11. University of Florida, Gainesville, FL, USA

12. University of Padua, Italy

13. The Pennsylvania State University, University Park, PA, USA

14. University of Würzburg, Germany

15. Pennsylvania State University Abington, Abington, PA, USA

16. University of Social Sciences and Humanities Campus Sopot, Sopot, Poland

17. Tilburg University, Tilburg, The Netherlands

18. City University of New York, New York, USA

19. Koç University, Istanbul, Turkey

20. University of Michigan, Ann Arbor, MI, USA

21. PRIME Research, Ann Arbor, MI, USA

22. HELP University, Kuala Lumpur, Malaysia

23. Texas A&M University, College Station, TX, USA

24. San Diego State University, San Diego, CA, USA

25. Mount Saint Vincent University, Nova Scotia, Canada

26. Radboud University Nijmegen, The Netherlands

27. University Nijmegen, The Netherlands

28. Virginia Commonwealth University, Richmond, VA, USA

29. Texas A&M University-Commerce, Commerce, TX, USA

30. Loyola University Chicago, IL, USA

31. Worcester Polytechnic Institute, Worcester, MA, USA

32. London School of Economics and Political Science, London, UK

33. James Madison University, Harrisonburg, VA, USA

34. Occidental College, Los Angeles, CA, USA

35. University of Virginia, Charlottesville, VA, USA

36. McDaniel College, Westminster, MD, USA

37. Connecticut College, New London, CT, USA

38. Wilfrid Laurier University, Waterloo, ON, Canada

39. University of Brasilia, DF, Brazil

40. California State University, Northridge, CA, USA

41. Ohio State University, Columbus, OH, USA

42. University of Wisconsin-Madison, Madison, WI, USA

43. Ithaca College, Ithaca, NY, USA

44. Charles University, Prague, Czech Republic

45. Western Kentucky University, Bowling Green, KY, USA

46. Washington and Lee University, Lexington, VA, USA

47. Center for Open Science, Charlottesville, VA, USA

48. Princeton University, Princeton, NJ, USA

Abstract

While direct replications such as the “Many Labs” project are extremely valuable in testing the reliability of published findings across laboratories, they reflect the common reliance in psychology on single vignettes or stimuli, which limits the scope of the conclusions that can be reached. New experimental tools and statistical techniques make it easier to routinely sample stimuli, and to appropriately treat them as random factors. We encourage researchers to get into the habit of including multiple versions of the content (e.g., stimuli or vignettes) in their designs, to increase confidence in cross-stimulus generalization and to yield more realistic estimates of effect size. We call on editors to be aware of the challenges inherent in such stimulus sampling, to expect and tolerate unexplained variability in observed effect size between stimuli, and to encourage stimulus sampling instead of the deceptively cleaner picture offered by the current reliance on single stimuli.

Publisher

Hogrefe Publishing Group

Subject

General Psychology,Sociology and Political Science,Arts and Humanities (miscellaneous),Social Psychology

Link

https://econtent.hogrefe.com/doi/pdf/10.1027/1864-9335/a000202

Cited by 52 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Averse to what: Consumer aversion to algorithmic labels, but not their outputs?;Current Opinion in Psychology;2024-08

2. Courageous Role Model or Threatening Villain: A Parallel Mediation Model of Corporate Activism and Citizen Political Engagement;Business & Society;2024-07-26

3. How Culture Shapes What People Want From AI;Proceedings of the CHI Conference on Human Factors in Computing Systems;2024-05-11

4. Creating a Bot-tleneck for malicious AI: Psychological methods for bot detection;Behavior Research Methods;2024-04-01

5. The relationship between political ideology and judgements of bias in distributional outcomes;Nature Human Behaviour;2024-02-26