Combining Deep Features and Hand-crafted Features for Abnormality Detection in WCE Images

Abstract

Abstract In this paper, a computer-aided method is proposed for abnormality detection Wireless Capsule Endoscopy (WCE) video frames. Common abnormalities in WCE images include ulcers, bleeding, Angiodysplasia, Lymphoid Hyperplasia, and polyp. In this paper, deep features and Hand-crafted features are combined to detect these abnormalities in WCE images. There are no sufficient images to train deep structures therefore the ResNet50 pertained model is used to extract deep features. Hand-crafted features are associated with color, shape, and texture. They are extracted from the region of interest (ROI), i.e. suspicious region. The expectation Maximization (EM) algorithm is used to extract more distinct areas in the background as ROI. The expectation Maximization (EM) algorithm is configured in a way that can extract the area with a distinct texture and color as ROI. The EM algorithm is also initialized with a new fast method which leads to an increase in the accuracy of the method. We also used a novel idea to reveal unexpected color changes in the background due to existing lesions as a feature set. A large number of features are created by the method, so the minimum redundancy maximum relevance approach is used to select a subset of more effective features. These selected features are then fed to a Support Vector Machine for classification. The results show that the proposed approach can detect mentioned abnormalities in WCE frames with the accuracy of 97.82%