Problematic Phrases in the Conclusions of Published Outcome Studies

Abstract

Objective: This study examined the extent to which conclusions of published outcome studies contain phrases that could be misconstrued as implying more empirical support than is warranted. Methods: All articles (N = 138) reporting outcome studies from 2000 to 2005 in two social work research journals and two topical database searches were assessed regarding research design, findings, and wording of conclusions. Substantial interrater agreement was indicated by kappa values of .95 for research design, 1.00 for nature of findings, and .70 for wording of conclusions. Results: Of the articles, 70% used designs that do not warrant making conclusive causal inferences, and 60% of articles with those designs contained phrases that could be misconstrued or exploited as implying an inflated evidence-based status. Conclusion: To prevent evidence-based practice from becoming a meaningless shibboleth, authors, reviewers, and editors should become vigilant in avoiding wording that could be misconstrued as implying more empirical support than is warranted.