The potential of digital behavioural tests as a diagnostic aid for psychosis

Abstract

Timely interventions have a proven benefit for people experiencing psychotic illness. One bottleneck to accessing timely interventions is the referral process to the specialist team for early psychosis (STEP). Many general practitioners lack awareness or confidence in recognising psychotic symptoms or state. Additionally, referrals for people without apparent psychotic symptoms, although beneficial at a population level, lead to excessive workload for STEPs. There is a clear unmet need for accurate stratification of STEPs users and healthy cohorts. Here we propose a new approach to addressing this need via the application of digital behavioural tests. To demonstrate that digital behavioural tests can be used to discriminate between the STEPs users (SU; n = 32) and controls (n = 32, age and sex matched), we compared performance of five different classifiers applied to objective, quantitative and interpretable features derived from the ‘mirror game’ (MG) and trail making task (TMT). The MG is a movement coordination task shown to be a potential socio-motor biomarker of schizophrenia, while TMT is a neuropsychiatric test of cognitive function. All classifiers had AUC in the range of 0.84–0.92. The best of the five classifiers (linear discriminant classifier) achieved an outstanding performance, AUC = 0.92 (95%CI 0.75–1), Sensitivity = 0.75 (95%CI 0.5–1), Specificity = 1 (95%CI 0.75–1), evaluated on 25% hold-out and 1000 folds. Performance of all analysed classifiers is underpinned by the large effect sizes of the differences between the cohorts in terms of the features used for classification what ensures generalisability of the results. We also found that MG and TMT are unsuitable in isolation to successfully differentiate between SU with and without at-risk-mental-state or first episode psychosis with sufficient level of performance. Our findings show that standardised batteries of digital behavioural tests could benefit both clinical and research practice. Including digital behavioural tests into healthcare practice could allow precise phenotyping and stratification of the highly heterogenous population of people referred to STEPs resulting in quicker and more personalised diagnosis. Moreover, the high specificity of digital behavioural tests could facilitate the identification of more homogeneous clinical high-risk populations, benefiting research on prognostic instruments for psychosis. In summary, our study demonstrates that cheap off-the-shelf equipment (laptop computer and a leap motion sensor) can be used to record clinically relevant behavioural data that could be utilised in digital mental health applications.