External validation and updating of a prediction model for the diagnosis of gestational diabetes mellitus

Abstract

ABSTRACTIntroductionThe Monash early pregnancy prediction model calculates risks of developing GDM and is internationally externally validated and implemented in practice, however some gaps remain.ObjectiveTo validate and update Monash GDM model, revising ethnicity categorisation, updating to recent diagnostic criteria, to improve performance and generalisability.MethodsRoutine health data for singleton pregnancies from 2016 to 2018 in Australia included updated GDM diagnostic criteria. The Original Model predictors were included (age, body mass index, ethnicity, diabetes family history, past-history of GDM, past-history of poor obstetric outcomes, ethnicity), with ethnicity revised. Updating model methods were: recalibration-in-the-large (Model A); re-estimation of intercept and slope (Model B), and; coefficients revision using logistic regression (Mode1 C1 with original eight ethnicity categories, and Mode1 C2 with updated 6 ethnicity categories). Analysis included ten-fold cross-validation, performance measures (c-statistic, calibration-in-the-large value, calibration slope and expected-observed (E:O) ratio) and closed testing examining log-likelihood scores and AIC compared models.ResultsIn 26,474 singleton pregnancies (4,756, 18% with GDM), we showed that temporal validation of the original model was reasonable (c-statistic 0.698) but with suboptimal calibration (E:O of 0.485). Model C2 was preferred, because of the high c-statistic (0.732), and it performed significantly better in closed testing compared to other models.ConclusionsUpdating of the original model sustains predictive performance in a contemporary population, including ethnicity data, recent diagnostic criteria, and universal screening context. This supports the value of risk prediction models to guide risk-stratified care to women at risk of GDM.Trial registration detailsThis study was registered as part of the PeRSonal GDM study on the Australian and New Zealand Clinical Trials Registry (ACTRN12620000915954); Pre-results.