School-based programmes that seem to work

Abstract

H. Pape: School-based programmes that seem to work: Useful research on substance use prevention or suspicious stories of success? School-based prevention programmes targeted at adolescent substance use rarely seem to have the desired effects on behaviour. It is true that some outcome studies do conclude that such programmes have been successful, but they are relatively few and far between. Even so, one may ask whether the body of published research in this field may originate from unrealistic optimism due to publication bias and underreporting of no or counterproductive effects. Thus, anecdotal evidence suggests that the literature is biased in favour of studies with positive findings. Moreover, nearly all these studies have been carried out by programme developers, and it is well known that researchers with vested interests are more likely to bring “good news” than independent researchers. Indeed, rather than approaching the field with critical reflection, some evaluators have intended to prove that school-based prevention works and have conducted their research accordingly. Examples of questionable analytical approaches and selective reporting of positive ifindings are consequently not hard to find. The external validity of evaluation studies with favourable outcomes is also often questionable because they almost exclusively have assessed the effects of programmes delivered under optimal rather than real-life conditions. In conclusion, the empirical “evidence” in favour of school-based substance use prevention programmes is generally weak and does not allow recommendation of widespread dissemination of any specific programme.