Optimizing Patient-Specific Medication Regimen Policies Using Wearable Sensors in Parkinson’s Disease

Abstract

Effective treatment of Parkinson’s disease (PD) is a continual challenge for healthcare providers, and providers can benefit from leveraging emerging technologies to supplement traditional clinic care. We develop a data-driven reinforcement learning (RL) framework to optimize PD medication regimens through wearable sensors. We leverage a data set of n = 26 PD patients who wore wrist-mounted movement trackers for two separate six-day periods. Using these data, we first build and validate a simulation model of how individual patients’ movement symptoms respond to medication administration. We then pair this simulation model with an on-policy RL algorithm that recommends optimal medication types, timing, and dosages during the day while incorporating human-in-the-loop considerations on medication administration. The results show that the RL-prescribed medication regimens outperform physicians’ medication regimens, despite physicians having access to the same data as the RL agent. To validate our results, we assess our wearable-based RL medication regimens using n = 399 PD patients from the Parkinson’s Progression Markers Initiative data set. We show that the wearable-based RL medication regimens would lead to significant symptom improvement for these patients, even more so than training RL policies directly from this data set. In doing so, we show that RL models from even small data sets of wearable data can offer novel, generalizable clinical insights and medication strategies, which may outperform those derived from larger data sets without wearable data. This paper was accepted by Carri Chan, healthcare management. Funding: This research is partially supported by the Science Alliance, University of Tennessee and by the Laboratory Directed Research and Development Program, Oak Ridge National Laboratory managed by UT-Battelle, LLC for the U.S. Department of Energy. Data used in this article were obtained from the Parkinson Progression Markers Initiative (PPMI) database, which is sponsored by the Michael J. Fox Foundation for Parkinson’s Research (MJFF). Supplemental Material: The data files and online appendix are available at https://doi.org/10.1287/mnsc.2023.4747 .