Assessing real-world gait with digital technology? Validation, insights and recommendations from the Mobilise-D consortium

Abstract

Abstract Background: Although digital mobility outcomes (DMOs) can be readily calculated from real-world data collected with wearable devices (WD) and ad-hoc algorithms, technical validation is still required. The aim of this paper is to comparatively assess and validate DMOs estimated using real-world gait data from six different cohorts, focusing on gait sequence detection (GSD), foot initial contact detection (ICD), cadence (CAD) and stride length (SL) estimates. Methods: Twenty healthy older adults, 20 people with Parkinson’s disease, 20 with multiple sclerosis, 19 with proximal femoral fracture (PFF), 17 with chronic obstructive pulmonary disease and 12 with congestive heart failure were monitored for 2.5 hours in the real-world, using a WD worn on the lower back. A reference system combining inertial modules with distance sensors and pressure insoles was used for comparison of DMOs from the WD. We assessed and validated three algorithms for GSD, four for ICD, three for CAD and four for SL by concurrently comparing their performances (e.g., accuracy, specificity, sensitivity, absolute and relative errors). Additionally, the effects of walking bout (WB) speed and duration on algorithm performance were investigated. Results: We identified two cohort-specific top performing algorithms for GSD and CAD, and a single best for ICD and SL. GSD best algorithms showed good performances (sensitivity > 0.73, positive predictive values > 0.75, specificity > 0.95, accuracy > 0.94). ICD and CAD algorithms presented excellent results, with sensitivity > 0.79, positive predictive values > 0.89 and relative errors < 11% for ICD and < 8.5% for CAD. The best identified SL algorithm showed lower performances than other DMOs (absolute error < 0.21 m). Lower performances across all DMOs were found for the cohort with most severe gait impairments (PFF). Algorithms’ performances were lower for short WBs; slower gait speeds (<0.5 m/s) resulted in reduced performance of the CAD and SL algorithms. Conclusions: Overall, the identified algorithms enabled a robust estimation of key DMOs. Our findingsshowed that the choice of algorithm for estimation of GSD and CAD DMOs should be cohort-specific (e.g., slow walkers and with gait impairments). Short WB length and slow walking speed worsened algorithms’ performances. Trial registration: ISRCTN – 12246987.