Dual-Layer Deep Ensemble Techniques for Classifying Heart Disease

Abstract

The prevalence of heart disease is increasing at a rapid rate due to changes in food habits and lifestyle of peopleall over the world. Early prediction and diagnosis of this fatal disease is a highly excruciating task. Nowadays, theensemble learning approaches are preferred owing to their effectiveness in performance when compared to theperformance of a single classification algorithm. In this work, a Dual-Layer Stacking Ensemble (DLSE) techniqueand a Deep Heterogeneous Ensemble (DHE) technique to classify heart disease are proposed. The DLSE uses several heterogeneous classifiers to form an ensemble that is efficient as well as diverse. The proposed frameworkconsists of two layers with the first layer consisting of three different base learning algorithms Naïve Bayes (NB),Decision Tree (DT), and Support Vector Machine (SVM). The second layer comprises of three different classifiers, Extremely Randomized Trees (ERT), Ada Boost Classifier (ABC) and Random Forest (RF). The second layerutilizes the results from the first layer to provide a diverse input for the three classifiers. Finally, the outcomesare fed to the meta-classifier Gradient Boosted Trees (GBT) to generate the final prediction. The DHE uses threedeep learning models Convolutional Neural Networks with Bidirectional Long Short-Term Memory (CNN BiLSTM), Artificial Neural Network (ANN) and Recurrent Neural Network (RNN) with RF, ERT and GBT as themeta-learners. The performance of the proposed methods is compared with traditional state-of-the-art classifiersas well as existing ensemble learning and deep learning methods. The experimental outcomes show that the proposed DLSE and DHE methods perform exceptionally in terms of accuracy, precision and recall measures.