External validation of the Norwegian anterior cruciate ligament reconstruction revision prediction model using patients from the STABILITY 1 Trial

Author:

Martin R. Kyle123ORCID,Marmura Hana4,Wastvedt Solvejg5,Pareek Ayoosh6,Persson Andreas37,Moatshe Gilbert37,Bryant Dianne8,Wolfson Julian5,Engebretsen Lars37,Getgood Alan4

Affiliation:

1. Department of Orthopaedic Surgery University of Minnesota Minneapolis Minnesota USA

2. Department of Orthopaedic Surgery, CentraCare Saint Cloud Minnesota USA

3. Oslo Sport Trauma Research Center Norwegian School of Sports Science Oslo Norway

4. Department of Orthopaedic Surgery University of Western Ontario London Ontario Canada

5. Division of Biostatistics University of Minnesota Minneapolis Minnesota USA

6. Department of Orthopedic Surgery Hospital for Special Surgery New York New York USA

7. Orthopaedic Clinic Oslo University Hospital Ullevål Oslo Norway

8. School of Physical Therapy University of Western Ontario London Ontario Canada

Abstract

AbstractPurposeA machine learning‐based anterior cruciate ligament (ACL) revision prediction model has been developed using Norwegian Knee Ligament Register (NKLR) data, but lacks external validation outside Scandinavia. This study aimed to assess the external validity of the NKLR model (https://swastvedt.shinyapps.io/calculator_rev/) using the STABILITY 1 randomized clinical trial (RCT) data set. The hypothesis was that model performance would be similar.MethodsThe NKLR Cox Lasso model was selected for external validation owing to its superior performance in the original study. STABILITY 1 patients with all five predictors required by the Cox Lasso model were included. The STABILITY 1 RCT was a prospective study which randomized patients to receive either a hamstring tendon autograft (HT) alone or HT plus a lateral extra‐articular tenodesis (LET). Since all patients in the STABILITY 1 trial received HT ± LET, three configurations were tested: 1: all patients coded as HT, 2: HT + LET group coded as bone‐patellar tendon‐bone (BPTB) autograft, 3: HT + LET group coded as unknown/other graft choice. Model performance was assessed via concordance and calibration.ResultsIn total, 591/618 (95.6%) STABILITY 1 patients were eligible for inclusion, with 39 undergoing revisions within 2 years (6.6%). Model performance was best when patients receiving HT + LET were coded as BPTB. Concordance was similar to the original NKLR prediction model for 1‐ and 2‐year revision prediction (STABILITY: 0.71; NKLR: 0.68–0.69). Concordance 95% confidence interval (CI) ranged from 0.63 to 0.79. The model was well calibrated for 1‐year prediction while the 2‐year prediction demonstrated evidence of miscalibration.ConclusionWhen patients in STABILITY 1 who received HT + LET were coded as BPTB in the NKLR prediction model, concordance was similar to the index study. However, due to a wide 95% CI, the true performance of the prediction model with this Canadian and European cohort is unclear and a larger data set is required to definitively determine the external validity. Further, better calibration for 1‐year predictions aligns with general prediction modelling challenges over longer periods. While not a large enough sample size to elicit the true accuracy and external validity of the prediction model when applied to North American patients, this analysis provides more support for the notion that HT plus LET performs similarly to BPTB reconstruction. In addition, despite the wide confidence interval, this study suggests optimism regarding the accuracy of the model when applied outside of Scandinavia.Level of EvidenceLevel 3, cohort study.

Publisher

Wiley

Subject

Orthopedics and Sports Medicine,Surgery

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3