Development and validation of a machine learning predictive model for perioperative myocardial injury in cardiac surgery with cardiopulmonary bypass

Abstract

Abstract Background Perioperative myocardial injury (PMI) with different cut-off values has showed to be associated with different prognostic effect after cardiac surgery. Machine learning (ML) method has been widely used in perioperative risk predictions during cardiac surgery. However, the utilization of ML in PMI has not been studied yet. Therefore, we sought to develop and validate the performances of ML for PMI with different cut-off values in cardiac surgery with cardiopulmonary bypass (CPB). Methods This was a second analysis of a multicenter clinical trial (OPTIMAL) and requirement for written informed consent was waived due to the retrospective design. Patients aged 18–70 undergoing elective cardiac surgery with CPB from December 2018 to April 2021 were enrolled in China. The models were developed using the data from Fuwai Hospital and externally validated by the other three cardiac centres. Traditional logistic regression (LR) and eleven ML models were constructed. The primary outcome was PMI, defined as the postoperative maximum cardiac Troponin I beyond different times of upper reference limit (40x, 70x, 100x, 130x) We measured the model performance by examining the area under the receiver operating characteristic curve (AUROC), precision-recall curve (AUPRC), and calibration brier score. Results A total of 2983 eligible patients eventually participated in both the model development (n = 2420) and external validation (n = 563). The CatboostClassifier and RandomForestClassifier emerged as potential alternatives to the LR model for predicting PMI. The AUROC demonstrated an increase with each of the four cutoffs, peaking at 100x URL in the testing dataset and at 70x URL in the external validation dataset. However, it’s worth noting that the AUPRC decreased with each cutoff increment. Additionally, the Brier loss score decreased as the cutoffs increased, reaching its lowest point at 0.16 with a 130x URL cutoff. Moreover, extended CPB time, aortic duration, elevated preoperative N-terminal brain sodium peptide, reduced preoperative neutrophil count, higher body mass index, and increased high-sensitivity C-reactive protein levels were identified as risk factors for PMI across all four cutoff values. Conclusions The CatboostClassifier and RandomForestClassifer algorithms could be an alternative for LR in prediction of PMI. Furthermore, preoperative higher N-terminal brain sodium peptide and lower high-sensitivity C-reactive protein were strong risk factor for PMI, the underlying mechanism require further investigation.