Affiliation:
1. School of Computer Science and Engineering, North Minzu University, Yinchuan 750021, China
Abstract
Learning from multiclass imbalanced data streams with concept drift and variable class imbalance ratios under a limited label budget presents new challenges in the field of data mining. To address these challenges, this paper proposes an adaptive active learning method for multiclass imbalanced data streams with concept drift (AdaAL-MID). Firstly, a dynamic label budget strategy under concept drift scenarios is introduced, which allocates label budgets reasonably at different stages of the data stream to effectively handle concept drift. Secondly, an uncertainty-based label request strategy using a dual-margin dynamic threshold matrix is designed to enhance learning opportunities for minority class instances and those that are challenging to classify, and combined with a random strategy, it can estimate the current class imbalance distribution by accessing only a limited number of instance labels. Finally, an instance-adaptive sampling strategy is proposed, which comprehensively considers the imbalance ratio and classification difficulty of instances, and combined with a weighted ensemble strategy, improves the classification performance of the ensemble classifier in imbalanced data streams. Extensive experiments and analyses demonstrate that AdaAL-MID can handle various complex concept drifts and adapt to changes in class imbalance ratios, and it outperforms several state-of-the-art active learning algorithms.
Funder
National Nature Science Foundation of China
Ningxia Natural Science Foundation Project
Central Universities Foundation of North Minzu University
Reference34 articles.
1. Evaluation of Supervised Machine Learning Algorithms for Multi-class Intrusion Detection Systems;Kaddoura;Proceedings of the Future Technologies Conference (FTC) 2021,2022
2. Machine learning for streaming data: State of the art, challenges, and opportunities;Gomes;ACM SIGKDD Explor. Newsl.,2019
3. Liu, W., Zhang, H., and Liu, Q. (2019, January 17–19). An air quality grade forecasting approach based on ensemble learning. Proceedings of the 2019 International Conference on Artificial Intelligence and Advanced Manufacturing (AIAM), Dublin, Ireland.
4. Learning under concept drift: A review;Lu;IEEE Trans. Knowl. Data Eng.,2018
5. Lipska, A., and Stefanowski, J. (2022, January 23). The Influence of Multiple Classes on Learning from Imbalanced Data Streams. Proceedings of the Fourth International Workshop on Learning with Imbalanced Domains: Theory and Applications, Grenoble, France.