Improving Services for People with a Psychotic Disorder and Problematic Substance Use: A Multifaceted Approach to Project Evaluation

Abstract

Objective: The objective of this study was to conduct a multifaceted formative evaluation of the Central Sydney Area Health Service (CSAHS) Psychosis and Substance Use Project. Method: Four evaluative methods were used: (i) description and interpretation of the Project's documented processes and outcomes; (ii) a benchmark comparison of the Project processes and outcomes against three of the 11 National Standards for Mental Health Services; (iii) a survey of the Project's key stakeholders; and (iv) interviews with 12 purposefully sampled key informants. Results: The Project achieved its aim to develop a strategy to improve services for people with comorbid psychosis and problematic substance use. Three of the five Project objectives were fully achieved: examination of current clinical services, development of a clinical services plan, and development of a staff education programme. The Project partially achieved two objectives: development of an information system, and a research agenda. The Project and CSAHS performed well when measured against three of the National Mental Health Standards. Project participants perceived the Project to have been successful and worth continuing, identified some shortcomings and made recommendations for the second phase. Conclusions: The participatory approach to the Project and the evaluation was successful. With some improvements the Project is worth continuing into a second phase. A multifaceted approach and qualitative research methods are useful for formative evaluation of health service programmes.