Affiliation:
1. Tecnologico de Monterrey, Estado de Mexico, Mexico
2. Tecnologico de Monterrey, Puebla, Mexico
3. University of Granada, Spain
Abstract
Experts from different domains have resorted to machine learning techniques to produce explainable models that support decision-making. Among existing techniques, decision trees have been useful in many application domains for classification. Decision trees can make decisions in a language that is closer to that of the experts. Many researchers have attempted to create better decision tree models by improving the components of the induction algorithm. One of the main components that have been studied and improved is the evaluation measure for candidate splits.
In this article, we introduce a tutorial that explains decision tree induction. Then, we present an experimental framework to assess the performance of 21 evaluation measures that produce different C4.5 variants considering 110 databases, two performance measures, and 10× 10-fold cross-validation. Furthermore, we compare and rank the evaluation measures by using a Bayesian statistical analysis. From our experimental results, we present the first two performance rankings in the literature of C4.5 variants. Moreover, we organize the evaluation measures into two groups according to their performance. Finally, we introduce meta-models that automatically determine the group of evaluation measures to produce a C4.5 variant for a new database and some further opportunities for decision tree models.
Funder
Spanish Ministry of Science and Technology
CONACyT under a postdoctoral project
Publisher
Association for Computing Machinery (ACM)
Subject
General Computer Science,Theoretical Computer Science
Reference102 articles.
1. Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
2. From logical inference to decision trees in medical diagnosis
3. A general class of coefficients of divergence of one distribution from another;Ali S. M.;J. Roy. Stat. Soc. Series B (Methodol.),1966
4. J. Alvarado-Uribe A. Gomez-Oliva A. Y. Barrera-Animas G. Molina M. Gonzalez-Mendoza M. C. Parra-Merono and A. J. Jara. 2018. HyRA: A hybrid recommendation algorithm focused on smart POI. Ceuti as a study scenario. Sensors (Basel) 18 3 (2018). J. Alvarado-Uribe A. Gomez-Oliva A. Y. Barrera-Animas G. Molina M. Gonzalez-Mendoza M. C. Parra-Merono and A. J. Jara. 2018. HyRA: A hybrid recommendation algorithm focused on smart POI. Ceuti as a study scenario. Sensors (Basel) 18 3 (2018).
5. A. B. Arrieta N. Díaz-Rodríguez J. Del Ser A. Bennetot S. Tabik A. Barbado S. García S. Gil-López D. Molina R. Benjamins R. Chatila and F. Herrera. 2019. Explainable Artificial Intelligence (XAI): Concepts Taxonomies Opportunities and Challenges toward Responsible AI. arxiv:1910.10045 (2019). A. B. Arrieta N. Díaz-Rodríguez J. Del Ser A. Bennetot S. Tabik A. Barbado S. García S. Gil-López D. Molina R. Benjamins R. Chatila and F. Herrera. 2019. Explainable Artificial Intelligence (XAI): Concepts Taxonomies Opportunities and Challenges toward Responsible AI. arxiv:1910.10045 (2019).
Cited by
13 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献