Young People’s Satisfaction With the Online Mental Health Service eheadspace: Development and Implementation of a Service Satisfaction Measure

Abstract

Background Online youth mental health services are an expanding approach to meeting service need and can be used as the first step in a stepped-care approach. However, limited evidence exists regarding satisfaction with online services, and there is no standardized service satisfaction measure. Objective This study implemented an online youth mental health service satisfaction questionnaire within eheadspace, an online youth mental health service. The aims were to test the questionnaire’s psychometric properties and identify current levels of satisfaction among service users, as well as to identify client and service contact characteristics that affect satisfaction. Methods Data were collected from 2280 eheadspace clients via an online questionnaire advertised and accessed through the eheadspace service platform between September 2016 and February 2018. Client and service contact characteristics, potential outcomes, and session and service feedback data were collected. Results The service satisfaction questionnaire demonstrated high internal consistency for the overall satisfaction scale (alpha=.95) and its three subscales: session satisfaction, potential outcomes, and service satisfaction. A three-factor model was the best fit to the data, although including a higher order unidimensional construct of overall satisfaction was also a reasonable fit. Overall, young people were very satisfied with eheadspace (mean 3.60, SD 0.83). Service characteristics, but not client characteristics, were significantly associated with satisfaction. Young people were more satisfied with eheadspace when they had greater engagement as evident through receiving esupport rather than briefer service provision, having a longer session and greater interaction with the clinician, and not previously attending a face-to-face headspace center. Conclusions The online youth mental health service satisfaction questionnaire developed for and implemented in eheadspace showed good psychometric properties. The measure is brief, has good internal consistency, and has a clear factor structure. The measure could be adapted for use in other online youth mental health services. The young people using eheadspace and completing the feedback survey were highly satisfied. Greater engagement with the online service was shown to be associated with greater satisfaction. No specific client demographic groups were shown to be more or less satisfied.