Effect of learning parameters on the performance of the U-Net architecture for cell nuclei segmentation from microscopic cell images

Abstract

Abstract Nuclei segmentation of cells is the preliminary and essential step of pathological image analysis. However, robust and accurate cell nuclei segmentation is challenging due to the enormous variability of staining, cell sizes, morphologies, cell adhesion or overlapping of the nucleus. The automation process to find the cell’s nuclei is a giant leap in this direction and has an important step toward bioimage analysis using software tools. This article extensively analyzes deep U-Net architecture and has been applied to the Data Science Bowl dataset to segment the cell nuclei. The dataset undergoes various preprocessing tasks such as resizing, intensity normalization and data augmentation prior to segmentation. The complete dataset then undergoes the rigorous training and validation process to find the optimized hyperparameters and then the optimized model selection. The mean (m) ± standard deviation (SD) of Intersection over Union (IoU) and F1-score (Dice score) have been calculated along with accuracy during the training and validation process, respectively. The optimized U-Net model results in a training IoU of 0.94 ± 0.16 (m ± SD), an F1-score of 0.94 ± 0.17 (m ± SD), a training accuracy of 95.54 and validation accuracy of 95.45. With this model, we applied a completely independent test cohort of the dataset and obtained the mean IOU of 0.93, F1-score of 0.9311, and mean accuracy of 94.12, respectively to measure the segmentation performance.