Author:
Bahrpeyma Fouad,Reichelt Dirk
Abstract
The smart factory is at the heart of Industry 4.0 and is the new paradigm for establishing advanced manufacturing systems and realizing modern manufacturing objectives such as mass customization, automation, efficiency, and self-organization all at once. Such manufacturing systems, however, are characterized by dynamic and complex environments where a large number of decisions should be made for smart components such as production machines and the material handling system in a real-time and optimal manner. AI offers key intelligent control approaches in order to realize efficiency, agility, and automation all at once. One of the most challenging problems faced in this regard is uncertainty, meaning that due to the dynamic nature of the smart manufacturing environments, sudden seen or unseen events occur that should be handled in real-time. Due to the complexity and high-dimensionality of smart factories, it is not possible to predict all the possible events or prepare appropriate scenarios to respond. Reinforcement learning is an AI technique that provides the intelligent control processes needed to deal with such uncertainties. Due to the distributed nature of smart factories and the presence of multiple decision-making components, multi-agent reinforcement learning (MARL) should be incorporated instead of single-agent reinforcement learning (SARL), which, due to the complexities involved in the development process, has attracted less attention. In this research, we will review the literature on the applications of MARL to tasks within a smart factory and then demonstrate a mapping connecting smart factory attributes to the equivalent MARL features, based on which we suggest MARL to be one of the most effective approaches for implementing the control mechanism for smart factories.
Subject
Artificial Intelligence,Computer Science Applications
Reference78 articles.
1. Idle vehicle rebalancing in semiconductor fabrication using factorized graph neural network reinforcement learning;Ahn,2019
2. Cooperative zone-based rebalancing of idle overhead hoist transportations using multi-agent reinforcement learning with graph representation learning;Ahn;IISE Trans.,2021
3. Dynamic energy scheduling and routing of a large fleet of electric vehicles using multi-agent reinforcement learning;Alqahtani;Comput. Ind. Eng.,2022
4. Deep reinforcement learning: A brief survey;Arulkumaran;IEEE Signal Process. Mag.,2017
5. Multi agent deep q-network approach for online job shop scheduling in flexible manufacturing;Baer,2020
Cited by
8 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献