SYSTEM ANALYSIS IN HIERARCHICAL INTELLIGENT MULTI-AGENT SYSTEMS

Abstract

The system analysis of the hierarchical intelligent multi-agent system in general, as well as its main structural unit, the intelligent agent, its major subsystems identified. As part of the analysis of the computer vision subsystem, it was concluded that the considered sources have insufficiently worked out issues related to the processing of occlusions, with the automation of the process of reconstruction of three-dimensional scenes, with the implementation of the processing of an unstructured set of images. The structure of the block for the reconstruction of three-dimensional scenes is proposed, the implementation of which is aimed at eliminating the indicated problems characteristic of the machine vision subsystem. The analysis of the main methods of implementing unsupervised learning is carried out, based on the results of which it is concluded that it is advisable to use reinforcement learning when implementing systems of this type. Such types of reinforcement learning as hierarchical reinforcement learning and multi-agent reinforcement learning are considered. A method for segmentation of macro actions is proposed, based on the implementation of clustering by the method of label propagation, in which the number of transitions is formalized in the form of weight coefficients of edges.