Affiliation:
1. Chair of Information and Automation Systems for Process and Material Technology , 9165 RWTH Aachen University , Turmstr. 46 , Aachen , Germany
Abstract
Abstract
Machine learning and particularly reinforcement learning methods may be applied to control tasks ranging from single control loops to the operation of whole production plants. However, their utilization in industrial contexts lacks understandability and requires suitable levels of operability and maintainability. In order to asses different application scenarios a simple measure for their complexity is proposed and evaluated on four examples in a simulated palette transport system of a cold rolling mill. The measure is based on the size of controller input and output space determined by different granularity levels in a hierarchical process control model. The impact of these decomposition strategies on system characteristics, especially operability and maintainability, are discussed, assuming solvability and a suitable quality of the reinforcement learning solution is provided.
Funder
Bundesministerium für Bildung und Forschung
Subject
Electrical and Electronic Engineering,Computer Science Applications,Control and Systems Engineering
Reference27 articles.
1. Barredo-Arrieta, A., I. Laña and J. Del Ser. 2019. What lies beneath: A note on the explainability of black-box machine learning models for road traffic forecasting. In: Intelligent Transportation Systems Conference (ITSC).
2. Dann, C. and E. Brunskill. 2015. Sample Complexity of Episodic Fixed-Horizon Reinforcement Learning. arXiv preprint.
3. Elfaham, H. and U. Epple. 2020. Meta Models for Intralogistics. at – Automatisierungstechnik 68(3): 208–221.
4. Furuta, H., T. Matsushima, T. Kozuno, Y. Matsuo, S. Levine, O. Nachum and S. S. Gu. 2021. Policy Information Capacity: Information-Theoretic Measure for Task Complexity in Deep Reinforcement Learning. arXiv preprint.
5. Gazzaneo, V., J. C. Carrasco, D. R. Vinson and F. V. Lima. 2019. Process Operability Algorithms: Past, Present, and Future Developments. Industrial & Engineering Chemistry Research 59(6): 2457–2470.