Local Binary Convolutional Neural Networks' Long Short-Term Memory Model for Human Embryos' Anomaly Detection

Abstract

Accurate selection of embryos with the maximum implementation condition is a necessary step to increase the effectiveness of fertility treatment in in vitro fertilization (IVF). The deep learning algorithms presented high potential for monitoring and visualizing embryo features such as cell numbers and their morphological development in time series manner. Due to the ability of the computer vision and deep learning algorithms, this paper aimed to present a novel deep learning approach to distinguish simultaneous abnormality of embryos in time-lapse systems for detecting live and non-live births in IVF. The approach is composed of local binary convolutional neural network (LBCNN) and long short-term memory (LSTM). The LBCNN improved accuracy of classification by employing deep and local feature sets with lower number of learnable parameters in comparison with a standard convolutional layer. Moreover, LSTM network is employed to analyze temporal information of time-lapse embryos. The results indicate that the proposed approach achieves significant results in ROC analysis (0.98) in 5 days of monitoring compared to state-of-the-art models. In addition, the approach showed compatible results in early diagnosis of abnormality detection (72 hours) with 82.8% accuracy of classification compared to the pretrained well-known convolutional neural network (CNN) models and baseline CNN.