Affiliation:
1. Karlsruhe Institute of Technology (KIT), Germany
Abstract
Thermal optimization of a heterogeneous clustered multi-core processor under user-defined QoS targets requires application migration and DVFS. However, selecting the core to execute each application and the VF levels of each cluster is a complex problem because (1) the diverse characteristics and QoS targets of applications require different optimizations, and (2) per-cluster DVFS requires a global optimization considering all running applications. State-of-the-art resource management for power or temperature minimization either relies on measurements that are commonly not available (such as power) or fails to consider all the dimensions of the optimization (e.g., by using simplified analytical models). To solve this, ML methods can be employed. In particular, IL leverages the optimality of an oracle policy, yet at low run-time overhead, by training a model from oracle demonstrations. We are the first to employ IL for temperature minimization under QoS targets. We tackle the complexity by training NN at design time and accelerate the run-time NN inference using NPU. While such NN accelerators are becoming increasingly widespread, they are so far only used to accelerate user applications. In contrast, we use for the first time an existing accelerator on a real platform to accelerate NN-based resource management. To show the superiority of IL compared to RL in our targeted problem, we also develop multi-agent RL-based management. Our evaluation on a
HiKey 970
board with an
Arm big.LITTLE
CPU and NPU shows that IL achieves significant temperature reductions at a negligible run-time overhead. We compare
TOP-IL
against several techniques. Compared to
ondemand
Linux governor,
TOP-IL
reduces the average temperature by up to 17 ˆC at minimal QoS violations for both techniques. Compared to the RL policy, our
TOP-IL
achieves 63 % to 89 % fewer QoS violations while resulting similar average temperatures. Moreover,
TOP-IL
outperforms the RL policy in terms of stability. We additionally show that our IL-based technique also generalizes to different software (unseen applications) and even hardware (different cooling) than used for training.
Funder
Deutsche Forschungsgemeinschaft
Publisher
Association for Computing Machinery (ACM)
Subject
Electrical and Electronic Engineering,Computer Graphics and Computer-Aided Design,Computer Science Applications
Reference42 articles.
1. Dario Amodei Chris Olah Jacob Steinhardt Paul Christiano John Schulman and Dan Mané. 2016. Concrete problems in Ai safety. arXiv:1606.06565. Retrieved from https://arxiv.org/abs/1606.06565
2. AdaMD: Adaptive Mapping and DVFS for Energy-Efficient Heterogeneous Multicores
3. Algorithmic Optimization of Thermal and Power Management for Heterogeneous Mobile Platforms
4. The PARSEC benchmark suite
5. Silas Boyd-Wickizer, Haibo Chen, Rong Chen, Yandong Mao, Frans Kaashoek, Robert Morris, Aleksey Pesterev, Lex Stein, Ming Wu, Yuehua Dai, Yang Zhang, and Zheng Zhang. 2008. Corey: An operating system for many cores. In Proceedings of the Symposium Operating System Design and Implementation (OSDI).