The main contribution of this paper is to present a novel approach for classifying the sleep stages based on optimal feature selection with ensemble learning stacking model using single-channel EEG signals.To find the suitable features from extracted feature vector, we obtained the ReliefF (ReF), Fisher Score (FS) and Online Stream Feature Selection (OSFS) selection algorithms.The proposed research work was performed on two different subgroups of sleep data of ISRUC-Sleep dataset. The experimental results of the proposed methodology signify that single-channel of EEG signal superior to other machine learning classification models with overall accuracies of 97.93%, 97%, and 95.96% using ISRUC-Sleep subgroup-I (SG-I) data and similarly the proposed model achieved an overall accuracies of 98.16%, 98.78%, and 95.26% using ISRUC-Sleep subgroup-III (SG-III) data with FS, ReF and OSFS respectively.