Patient-Type Bayes-Adaptive Treatment Plans

Abstract

Treatment decisions that explicitly consider patient heterogeneity can lower the cost of care and improve outcomes by providing the right care for the right patient at the right time. “Patient-Type Bayes-Adaptive Treatment Plans” analyzes the problem of designing ongoing treatment plans for a population with heterogeneity in disease progression and response to medical interventions. The authors create a model that learns the patient type by monitoring patient health over time and updates a patient's treatment plan according to the information gathered. The authors formulate the problem as a multivariate state space partially observable Markov decision process (POMDP). They provide structural properties of the optimal policy and develop several approximate policies and heuristics to solve the problem. As a case study, they develop a data-driven decision-analytic model to study the optimal timing of vascular access surgery for patients with progressive chronic kidney disease. They provide further policy insights that sharpen existing guidelines.