Author:
Field Sarahanne M.,Volz Leonhard,Kaznatcheev Artem,van Dongen Noah
Abstract
AbstractThe replication crisis threatens to seriously impact theory development in the cognitive, behavioral, and social sciences. We canvas three desiderata of scientific theories (explanation, prediction, and unification) and argue that the extent to which failures of replication prove problematic depends on the primary purpose of a theory. If the aim is to explain how nature works, then accuracy—and thus replicability—of the findings on which the theory is built is essential. If the aim is to predict outcomes, then replicability of findings from which the predictive model or theory is built is only important as far as it affects the reliability and accuracy of the predictions. If the aim is to unify and organize disparate findings, then the replicability of findings plays a non-essential role. The result is that a multifaceted and nuanced perspective is required to assess the value of replicability and the need for replication studies. Specifying a theory’s purpose and background commitments should clarify the debate on replication and contribute to better theory development in the cognitive, behavioral, and social sciences.
Publisher
Springer Science and Business Media LLC
Reference55 articles.
1. Bacon, F. (1878[1620]). Novum organum. Clarendon Press.
2. Baker, M. (2016). 1,500 scientists lift the lid on reproducibility. Nature, 533(7604), 452–454.
3. Buzbas, E. O., Devezer, B., & Baumgaertner, B. (2023). The logical structure of experiments lays the foundation for a theory of reproducibility. Royal Society Open Science, 10(3), 221042.
4. Chakravartty, A. (2017). Scientific Realism. E. N. Zalta (Ed.), The Stanford Encyclopedia of Philosophy (Summer 2017 ed.). Metaphysics Research Lab, Stanford University. https://plato.stanford.edu/archives/sum2017/entries/scientific-realism/.
5. Cheng, M., Smith, D. S., Ren, X., Cao, H., Smith, S., & McFarland, D. A. (2023). How new ideas diffuse in science. American Sociological Review, 88(3), 522–561.