Systematic review and meta-analysis

Abstract

Aim:This paper provides an overview of the research methodologies of systematic review and meta-analysis and uses a commentary on the analysis of data from a previously published study to illustrate the procedures and decision-making involved for consumers and those who may be considering carrying out a systematic review.Rationale:Systematic review and meta-analysis are located within a hierarchy of evidence-based practice, and their underlying epistemological and theoretical basis considered. The advantages of systematic review over traditional narrative reviews are discussed, together with the case for the use of meta-analysis to synthesise research findings. The feasibility of the use of these methodologies by educational psychologists is also considered.Findings:The worked example details the steps necessary to carry out a systematic review and meta-analysis and the commentary addresses key issues such as specifying inclusion/exclusion criteria and determining relevance; specifying the literature search strategy and coping with the ‘grey’ literature; extracting and coding data from the included studies and the importance of reliability checks; study quality; selecting the most appropriate effect size; selecting the most appropriate model for meta-analysis (fixed-effect versus randomeffect), combining and averaging effect sizes across studies; running weighted ANOVAs or meta-regression analyses to investigate heterogeneity; checks for publication bias; and sensitivity analysis to deal with outliers.Conclusions:Future developments in these methodologies, details of available software and resources, and implications for educational psychologists who may wish to carry out systematic reviews and meta-analysis are discussed.