|
This article is cited in 4 scientific papers (total in 4 papers)
Simultaneous learning and planning in a hierarchical control system for a cognitive agent
A. I. Panovab a Federal Research Center “Computer Science and Control,” Russian Academy
of Sciences, Moscow, 119333 Russia
b Moscow Institute of Physics and Technology, Dolgoprudnyi, Moscow oblast, 141701 Russia
Abstract:
The tasks of behavior planning and decision-making learning in a dynamic environment are usually divided and considered separately in control systems for intelligent agents. A new unified hierarchical formulation of the problem of simultaneous learning and planning (SLAP) is proposed in the context of object-oriented reinforcement learning, and an architecture of a cognitive agent that solves this problem is described. A new algorithm for learning actions in a partially observed external environment is proposed using a reward signal, an object-oriented subject description of the states of the external environment, and dynamically updated action plans. The main properties and advantages of the proposed algorithm are considered, including the lack of a fixed cognitive cycle necessitating the separation of planning and learning subsystems in earlier algorithms and the ability to construct and update the model of interaction with the environment, thus increasing the learning efficiency. A theoretical justification of some provisions of this approach is given, a model example is proposed, and the principle of operation of a SLAP agent when driving an unmanned vehicle is demonstrated.
Keywords:
reinforcement learning, behavior planning, cognitive agent, hierarchical planning, control system, unmanned vehicle, mobile robot.
Citation:
A. I. Panov, “Simultaneous learning and planning in a hierarchical control system for a cognitive agent”, Avtomat. i Telemekh., 2022, no. 6, 53–71; Autom. Remote Control, 83:6 (2022), 869–883
Linking options:
https://www.mathnet.ru/eng/at15976 https://www.mathnet.ru/eng/at/y2022/i6/p53
|
Statistics & downloads: |
Abstract page: | 103 | References: | 33 | First page: | 18 |
|