Development and validation of a neural network-based survival model for mortality prediction in ischemic heart disease
Author:
Brunak Søren1ORCID, Holm Peter1, Haue Amalie Dahl1ORCID, Westergaard David1, Röder Timo1, Banasik Karina1, Tragante Vinicius2, Christensen Alex3, Thomas Laurent4ORCID, Nøst Therese4, Skogholt Anne Heidi4, Iversen Kasper5, Pedersen Frants3, Høfsten Dan3, Pedersen Ole6, Ostrowski Sisse7ORCID, Ullum Henrik8, Svendsen Mette1, Gjødsbøl Iben1, Gudnason Thorarinn9, Gudbjartsson Daniel2, Helgadottir Anna2, Hveem Kristian10, Køber Lars3, Holm Hilma2, Stefansson Kari2, Bundgaard Henning3
Affiliation:
1. University of Copenhagen 2. deCODE genetics 3. Copenhagen University Hospital 4. Norwegian University of Technology and Science 5. Copenhagen University Hospital Herlev and Gentofte, Herlev, Denmark 6. Naestved Hospital 7. Rigshospitalet, Copenhagen University Hospital 8. Statens Serum Institut 9. Landspitali University Hospital 10. Norwegian University of Science and Technology
Abstract
Abstract
Background
The reduced precision of currently applied risk prediction models for patients with ischemic heart disease (IHD) is a limitation for clinical use. Using machine learning to integrate a much broader panel of features from electronic health records (EHRs) may improve precision markedly.
Methods
The development and validation of a prediction model for IHD in this study was based on Danish and Icelandic data from clinical quality databases, national registries, and electronic health records. Danish patients suspected for IHD and referred for a coronary angiography showing 1, 2, or 3 vessel-disease or diffuse coronary artery disease between 2006 and 2016 were included for model development (n = 39,746). Time to all-cause mortality, the prediction target, was tracked until 2019, or up to 5 years, whichever came first. To model time-to-event data and address censoring, neural network-based discrete-time survival models were used. Our prediction model, PMHnet, used up to 584 different features including clinical characteristics, laboratory findings, and diagnosis and procedure codes. Model performance was evaluated using time-dependent AUC (tdAUC) and the Brier score and was benchmarked against the updated GRACE risk score and less feature-rich neural network models. Models were evaluated using hold-out data (n = 5,000) and external validation data from Iceland (n = 8,287). Feature importance and model explainability factors were assessed using SHAP analysis.
Findings
: On the test set (n = 5,000), the tdAUC of PMHnet was 0.88[0.86–0.90] (case count = 196) at six months, 0.88[0.86–0.90] (cc = 261) at one year, 0.84[0.82–0.86] (cc = 395) at three years, and 0.82[0.80–0.84] (cc = 763) at five years. The model predictions were well-calibrated. PMHnet showed similar performance in the Icelandic data. Compared to the GRACE score and intermediate models limited to GRACE features or single data modalities, PMHnet had significantly better model discrimination across all evaluated prediction timepoints.
Interpretation:
More complex and feature-rich machine learning models improved prediction of all-cause mortality in patients with IHD and may be used to inform and guide clinical management.
Publisher
Research Square Platform LLC
Reference54 articles.
1. Collet, J.-P. et al. 2020 ESC Guidelines for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation: The Task Force for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation of the European Society of Cardiology (ESC). Eur. Heart J. 42, 1289–1367 (2021). 2. 2023 ESC Guidelines for the management of acute coronary syndromes;Byrne RA;Eur. Heart J.,2023 3. Knuuti, J. et al. 2019 ESC Guidelines for the diagnosis and management of chronic coronary syndromes: The Task Force for the diagnosis and management of chronic coronary syndromes of the European Society of Cardiology (ESC). Eur. Heart J. 41, 407–477 (2020). 4. Prediction of Coronary Heart Disease Using Risk Factor Categories;Wilson PWF;Circulation,1998 5. Should patients with acute coronary disease be stratified for management according to their risk? Derivation, external validation and outcomes using the updated GRACE risk score;Fox KAA;BMJ Open,2014
|
|