Publication: Learning to Avoid Risky Actions
Loading...
Identifiers
Publication date
2011-12
Defense date
Advisors
Tutors
Journal Title
Journal ISSN
Volume Title
Publisher
Taylor & Francis Group
Impact
Export
Abstract
When a reinforcement learning agent executes actions that can cause frequent damage to itself, it can learn, by using Q-learning, that these actions must not be executed again. However, there are other actions that do not cause damage frequently but only once in a while, for example, risky actions such as parachuting. These actions may imply punishment to the agent and, depending on its personality, it would be better to avoid them. Nevertheless, using the standard Q-learning algorithm, the agent is not able to learn to avoid them, because the result of these actions can be positive on average. In this article, an additional mechanism of Q-learning, inspired by the emotion of fear, is introduced in order to deal with those risky actions by considering the worst results. Moreover, there is a daring factor for adjusting the consideration of the risk. This mechanism is implemented on an autonomous agent living in a virtual environment. The results present the performance of the agent with different daring degrees.
Description
Keywords
Autonomous agent, Decision making system, Fear, Reinforcement learning, Risky actions
Bibliographic citation
Cybernetics and Systems: An International Journal, 2011, vol. 42 (8), pp. 636-658