A Video-based Automated Tracking and Analysis System of Plaque Burden in Carotid Artery using Deep Learning: A Comparison with Senior Sonographers

Abstract

Background and Objective: The incidence of stroke is rising, and it is the second major cause of mortality and the third leading cause of disability around the globe. The goal of this study was to rapidly and accurately identify carotid plaques and automatically quantify plaque burden using our automated tracking and segmentation US-video system. Methods: We collected 88 common carotid artery transection videos (11048 frames) with a history of atherosclerosis or risk factors for atherosclerosis, which were randomly divided into training, test, and validation sets using a 6:3:1 ratio. We first trained different segmentation models to segment the carotid intima and adventitia, and calculate the maximum plaque burden automatically. Finally, we statistically analyzed the plaque burden calculated automatically by the best model and the results of manual labeling by senior sonographers. Results: Of the three Artificial Intelligence (AI) models, the Robust Video Matting (RVM) segmentation model's carotid intima and adventitia Dice Coefficients (DC) were the highest, reaching 0.93 and 0.95, respectively. Moreover, the RVM model has shown the strongest correlation coefficient (0.61±0.28) with senior sonographers, and the diagnostic effectiveness between the RVM model and experts was comparable with paired-t test and Bland-Altman analysis [P= 0.632 and ICC 0.01 (95% CI: -0.24~0.27), respectively]. Conclusion: Our findings have indicated that the RVM model can be used in ultrasound carotid video. The RVM model can automatically segment and quantify atherosclerotic plaque burden at the same diagnostic level as senior sonographers. The application of AI to carotid videos offers more precise and effective methods to evaluate carotid atherosclerosis in clinical practice.