Automatic detection and segmentation of chorda tympani under microscopic vision in otosclerosis patients via convolutional neural networks

Abstract

AbstractBackgroundArtificial intelligence (AI) techniques, especially deep learning (DL) techniques, have shown promising results for various computer vision tasks in the field of surgery. However, AI‐guided navigation during microscopic surgery for real‐time surgical guidance and decision support is much more complex, and its efficacy has yet to be demonstrated. We propose a model dedicated to the evaluation of DL‐based semantic segmentation of chorda tympani (CT) during microscopic surgery.MethodsVarious convolutional neural networks were constructed, trained, and validated for semantic segmentation of CT. Our dataset has 5817 images annotated from 36 patients, which were further randomly split into the training set (90%, 5236 images) and validation set (10%, 581 images). In addition, 1500 raw images from 3 patients (500 images randomly selected per patient) were used to evaluate the network performance.ResultsWhen evaluated on a validation set (581 images), our proposed CT detection networks achieved great performance, and the modified U‐net performed best (mIOU = 0.892, mPA = 0.9427). Moreover, when applying U‐net to predict the test set (1500 raw images from 3 patients), our methods also showed great overall performance (Accuracy = 0.976, Precision = 0.996, Sensitivity = 0.979, Specificity = 0.902).ConclusionsThis study suggests that DL can be used for the automated detection and segmentation of CT in patients with otosclerosis during microscopic surgery with a high degree of performance. Our research validated the potential feasibility for future vision‐based navigation surgical assistance and autonomous surgery using AI.