Object-Specific Four-Path Network for Stroke Risk Stratification of Carotid Arteries in Ultrasound Images

Abstract

Atherosclerotic carotid plaques have been shown to be closely associated with the risk of stroke. Since patients with symptomatic carotid plaques have a greater risk for stroke, stroke risk stratification based on the classification of carotid plaques into symptomatic or asymptomatic types is crucial in diagnosis, treatment planning, and medical treatment monitoring. A deep learning technique would be a good choice for implementing classification. Usually, to acquire a high-accuracy classification, a specific network architecture needs to be designed for a given classification task. In this study, we propose an object-specific four-path network (OSFP-Net) for stroke risk assessment by integrating ultrasound carotid plaques in both transverse and longitudinal sections of the bilateral carotid arteries. Each path of the OSFP-Net comprises of a feature extraction subnetwork (FE) and a feature downsampling subnetwork (FD). The FEs in the four paths use the same network structure to automatically extract features from ultrasound images of carotid plaques. The FDs use different object-specific pooling strategies for feature downsampling based on the observation that the sizes and shapes in the feature maps obtained from FEs should be different. The object-specific pooling strategies enable the network to accept arbitrarily sized carotid plaques as input and to capture a more informative context for improving the classification accuracy. Extensive experimental studies on a clinical dataset consisting of 333 subjects with 1332 carotid plaques show the superiority of our OSFP-Net against several state-of-the-art deep learning-based methods. The experimental results demonstrate better clinical agreement between the ground truth and the prediction, which indicates its great potential for use as a risk stratification and as a monitoring tool in the management of patients at risk for stroke.