Abstract
AbstractTwo questions often arise in the field of the ensemble in multiclass classification problems, (i) how to combine base classifiers and (ii) how to design possible binary classifiers. Error-correcting output codes (ECOC) methods answer these questions, but they focused on only the general goodness of the classifier. The main purpose of our research was to strengthen the bottleneck of the ensemble method, i.e., to minimize the largest values of two types of error ratios in the deep neural network-based classifier. The research was theoretical and experimental, the proposed Min–Max ECOC method suggests a theoretically proven optimal solution, which was verified by experiments on image datasets. The optimal solution was based on the maximization of the lowest value in the Hamming matrix coming from the ECOC matrix. The largest ECOC matrix, the so-called full matrix is always a Min–Max ECOC matrix, but smaller matrices generally do not reach the optimal Hamming distance value, and a recursive construction algorithm was proposed to get closer to it. It is not easy to calculate optimal values for large ECOC matrices, but an interval with upper and lower limits was constructed by two theorems, and they were proved. Convolutional Neural Networks with Min–Max ECOC matrix were tested on four real datasets and compared with OVA (one versus all) and variants of ECOC methods in terms of known and two new indicators. The experimental results show that the suggested method surpasses the others, thus our method is promising in the ensemble learning literature.
Funder
Budapest University of Technology and Economics
Publisher
Springer Science and Business Media LLC
Subject
Computer Graphics and Computer-Aided Design,Computer Vision and Pattern Recognition,Software
Reference45 articles.
1. Ahmed, S.A.A., Zor, C., Awais, M., Yanikoglu, B., Kittler, J.: Deep convolutional neural network ensembles using ECOC. IEEE Access 9, 86083–86095 (2021)
2. Allwein, E.L., Schapire, R.E., Singer, Y.: Reducing multiclass to binary: a unifying approach for margin classifiers. J. Mach. Learn. Res. 1, 113–141 (2001)
3. Alshdaifat, E.A., Coenen, F., Dures, K.: A directed acyclic graph based approach to multi-class ensemble classification. In: International Conference on Innovative Techniques and Applications of Artificial Intelligence, pp. 43–57. Springer, Cham (2015)
4. Alvear-Sandoval, R.F., Sancho-Gómez, J.L., Figueiras-Vidal, A.R.: On improving CNNs performance: the case of MNIST. Inf. Fusion 52, 106–109 (2019). https://doi.org/10.1016/j.inffus.2018.12.005
5. Bagheri, M.A., Gao, Q., Escalera, S. Generic subclass ensemble: a novel approach to ensemble classification. In: 2014 22nd International Conference on Pattern Recognition, pp. 1254–1259. IEEE (2014)
Cited by
5 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献