Deep learning to estimate gestational age from fly‐to cineloop videos: A novel approach to ultrasound quality control

Abstract

AbstractObjectiveLow‐cost devices have made obstetric sonography possible in settings where it was previously unfeasible, but ensuring quality and consistency at scale remains a challenge. In the present study, we sought to create a tool to reduce substandard fetal biometry measurement while minimizing care disruption.MethodsWe developed a deep learning artificial intelligence (AI) model to estimate gestational age (GA) in the second and third trimester from fly‐to cineloops—brief videos acquired during routine ultrasound biometry—and evaluated its performance in comparison to expert sonographer measurement. We then introduced random error into fetal biometry measurements and analyzed the ability of the AI model to flag grossly inaccurate measurements such as those that might be obtained by a novice.ResultsThe mean absolute error (MAE) of our model (±standard error) was 3.87 ± 0.07 days, compared to 4.80 ± 0.10 days for expert biometry (difference −0.92 days; 95% CI: −1.10 to −0.76). Based on simulated novice biometry with average absolute error of 7.5%, our model reliably detected cases where novice biometry differed from expert biometry by 10 days or more, with an area under the receiver operating characteristics curve of 0.93 (95% CI: 0.92, 0.95), sensitivity of 81.0% (95% CI: 77.9, 83.8), and specificity of 89.9% (95% CI: 88.1, 91.5). These results held across a range of sensitivity analyses, including where the model was provided suboptimal truncated fly‐to cineloops.ConclusionsOur AI model estimated GA more accurately than expert biometry. Because fly‐to cineloop videos can be obtained without any change to sonographer workflow, the model represents a no‐cost guardrail that could be incorporated into both low‐cost and commercial ultrasound devices to prevent reporting of most gross GA estimation errors.