Affiliation:
1. Department of Computer Science Aberystwyth University Aberystwyth UK
2. Institute of Fundamental Technological Research Polish Academy of Sciences Warsaw Poland
3. Department of Radiology University of California San Diego California USA
4. Computer Vision and Robotics Institute University of Girona Girona Spain
5. Department of Computing and Mathematics Manchester Metropolitan University Manchester UK
Abstract
AbstractPurposeBUS‐Set is a reproducible benchmark for breast ultrasound (BUS) lesion segmentation, comprising of publicly available images with the aim of improving future comparisons between machine learning models within the field of BUS.MethodFour publicly available datasets were compiled creating an overall set of 1154 BUS images, from five different scanner types. Full dataset details have been provided, which include clinical labels and detailed annotations. Furthermore, nine state‐of‐the‐art deep learning architectures were selected to form the initial benchmark segmentation result, tested using five‐fold cross‐validation and MANOVA/ANOVA with Tukey statistical significance test with a threshold of 0.01. Additional evaluation of these architectures was conducted, exploring possible training bias, and lesion size and type effects.ResultsOf the nine state‐of‐the‐art benchmarked architectures, Mask R‐CNN obtained the highest overall results, with the following mean metric scores: Dice score of 0.851, intersection over union of 0.786 and pixel accuracy of 0.975. MANOVA/ANOVA and Tukey test results showed Mask R‐CNN to be statistically significant better compared to all other benchmarked models with a p‐value >0.01. Moreover, Mask R‐CNN achieved the highest mean Dice score of 0.839 on an additional 16 image dataset, that contained multiple lesions per image. Further analysis on regions of interest was conducted, assessing Hamming distance, depth‐to‐width ratio (DWR), circularity, and elongation, which showed that the Mask R‐CNN's segmentations maintained the most morphological features with correlation coefficients of 0.888, 0.532, 0.876 for DWR, circularity, and elongation, respectively. Based on the correlation coefficients, statistical test indicated that Mask R‐CNN was only significantly different to Sk‐U‐Net.ConclusionsBUS‐Set is a fully reproducible benchmark for BUS lesion segmentation obtained through the use of public datasets and GitHub. Of the state‐of‐the‐art convolution neural network (CNN)‐based architectures, Mask R‐CNN achieved the highest performance overall, further analysis indicated that a training bias may have occurred due to the lesion size variation in the dataset. All dataset and architecture details are available at GitHub: https://github.com/corcor27/BUS‐Set, which allows for a fully reproducible benchmark.
Reference48 articles.
1. Breast Cancer Now. Facts and statistics2020. Last accessed December 2020. https://breastcancernow.org/about‐us/media/facts‐statistics
2. Breast Cancer UK. Survival for breast cancer | Breast Cancer | Cancer Research UK. December2020. Last accessed December 2020. https://www.cancerresearchuk.org/about‐cancer/breast‐cancer/survival
3. Toward Novel Noninvasive and Low-Cost Markers for Predicting Strokes in Asymptomatic Carotid Atherosclerosis: The Role of Ultrasound Image Analysis
4. A non-invasive method for focusing ultrasound through the human skull
5. Computer-aided detection as a decision assistant in chest radiography
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献