An Intelligent Breast Ultrasound System for Diagnosis and 3D Visualization

Abstract

Background: Ultrasonography is the main examination method for breast diseases. Ultrasound imaging is currently relied upon by doctors to form statements of characteristics and locations of lesions, which severely limits the completeness and effectiveness of ultrasound image information. Moreover, analyzing ultrasonography requires experienced ultrasound doctors, which are not common in hospitals. Thus, this work proposes a 3D-based breast ultrasound system, which can automatically diagnose ultrasound images of the breasts and generate a representative 3D breast lesion model through typical ultrasonography. Methods: In this system, we use a weighted ensemble method to combine three different neural networks and explore different combinations of the neural networks. On this basis, a breast locator was designed to measure and transform the spatial position of lesions. The breast ultrasound software generates a 3D visualization report through the selection and geometric transformation of the nodular model. Results: The ensemble neural network improved in all metrics compared with the classical neural network (DenseNet, AlexNet, GoogLeNet, etc.). It proved that the ensemble neural network proposed in this work can be used for intelligent diagnosis of breast ultrasound images. For 3D visualization, magnetic resonance imaging (MRI) scans were performed to achieve their 3D reconstructions. By comparing two types of visualized results (MRI and our 3D model), we determined that models generated by the 3D-based breast ultrasound system have similar nodule characteristics and spatial relationships with the MRI. Conclusions: In summary, this system implements automatic diagnosis of ultrasound images and presents lesions through 3D models, which can obtain complete and accurate ultrasound image information. Thus, it has clinical potential.