Critical Evaluation of Published Research: Some Guidelines

Abstract

Studies of the quality of published educational research have indicated that, while the quality is improving, much published research still suffers from major weaknesses. This finding is particularly disconcerting since it is generally recognized that the average reader of educational journals lacks a sound understanding of the research process and of statistics and is, therefore, very likely to accept uncritically as true anything reported in the published literature. This article suggests ways in which the consumer of educational research can critically evaluate research reports in terms of sample and methodology, design and statistical treatment, and results and interpretation. The reader is alerted to sources of deliberate and nondeliberate bias and to fallacious use and/or interpretation of statistics. The reader of educational research must critically evaluate research in order to determine whether totally or partially to accept, or to question or reject reported findings.