The Role of Meta-Analysis in the Significance Test Controversy

Abstract

The critique against significance testing has been increasingly acknowledged in recent years. This paper focuses on the relation between meta-analysis and this controversy. A contradiction in the literature can be seen in that significance testing has been blamed for the poor accumulation of knowledge in psychology, while at the same time meta-analytic reviews have claimed the opposite. Although a majority of meta-analytic experts argue against significance testing, this critique cannot account for the success of meta-analysis. Rather, it may be that meta-analysis has facilitated the recognition of the significance test critique. Taking the significance testing critique seriously has important implications for meta-analysis in that its research base (e. g., studies) is viewed as unreliable. Although the significance test controversy may lead to further fragmentation of psychology, it is not clear that this will negatively affect the practice of meta-analysis.