Affiliation:
1. Computer and Systems Engineering Department, University of La Laguna, 38200 San Cristóbal de La Laguna, Spain
Abstract
Automated machine learning (AutoML), which aims to facilitate the design and optimization of machine-learning models with reduced human effort and expertise, is a research field with significant potential to drive the development of artificial intelligence in science and industry. However, AutoML also poses challenges due to its resource and energy consumption and environmental impact, aspects that have often been overlooked. This paper predominantly centers on the sustainability implications arising from computational processes within the realm of AutoML. Within this study, a proof of concept has been conducted using the widely adopted Scikit-learn library. Energy efficiency metrics have been employed to fine-tune hyperparameters in both Bayesian and random search strategies, with the goal of enhancing the environmental footprint. These findings suggest that AutoML can be rendered more sustainable by thoughtfully considering the energy efficiency of computational processes. The obtained results from the experimentation are promising and align with the framework of Green AI, a paradigm aiming to enhance the ecological footprint of the entire AutoML process. The most suitable proposal for the studied problem, guided by the proposed metrics, has been identified, with potential generalizability to other analogous problems.
Funder
Emerging Heterogeneous Architectures for Machine Learning and Energy Efficiency
Subject
Fluid Flow and Transfer Processes,Computer Science Applications,Process Chemistry and Technology,General Engineering,Instrumentation,General Materials Science
Reference72 articles.
1. Zhou, Z.H. (2021). Machine Learning, Springer Nature.
2. Finn, C., Abbeel, P., and Levine, S. (2017, January 6–11). Model-agnostic meta-learning for fast adaptation of deep networks. Proceedings of the International Conference on Machine Learning, PMLR, Sydney, Australia.
3. Tsiakmaki, M., Kostopoulos, G., Kotsiantis, S., and Ragos, O. (2019). Implementing AutoML in educational data mining for prediction tasks. Appl. Sci., 10.
4. Preuveneers, D. (2023). AutoFL: Towards AutoML in a Federated Learning Context. Appl. Sci., 13.
5. Shin, J., Park, K., and Kang, D.K. (2023). TA-DARTS: Temperature Annealing of Discrete Operator Distribution for Effective Differential Architecture Search. Appl. Sci., 13.