External Validation and Update of the Risk Prediction Model for Denosumab-Induced Hypocalcemia Developed From a Hospital-Based Administrative Database

Abstract

PURPOSE Denosumab is used to treat patients with bone metastasis from solid tumors, but sometimes causes severe hypocalcemia, so careful clinical management is important. This study aims to externally validate our previously developed risk prediction model for denosumab-induced hypocalcemia by using data from two facilities with different characteristics in Japan and to develop an updated model with improved performance and generalizability. METHODS In the external validation, retrospective data of Kameda General Hospital (KGH) and Miyagi Cancer Center (MCC) between June 2013 and June 2022 were used and receiver operating characteristic (ROC)-AUC was mainly evaluated. A scoring-based updated model was developed using the same data set from a hospital-based administrative database as previously employed. Selection of variables related to prediction of hypocalcemia was based on the results of external validation. RESULTS For the external validation, data from 235 KGH patients and 224 MCC patients were collected. ROC-AUC values in the original model were 0.879 and 0.774, respectively. The updated model consisting of clinical laboratory tests (calcium, albumin, and alkaline phosphatase) afforded similar ROC-AUC values in the two facilities (KGH, 0.837; MCC, 0.856). CONCLUSION We developed an updated risk prediction model for denosumab-induced hypocalcemia with small interfacility differences. Our results indicate the importance of using data from plural facilities with different characteristics in the external validation of generalized prediction models and may be generally relevant to the clinical application of risk prediction models. Our findings are expected to contribute to improved management of bone metastasis treatment.