Publication:
VQQL. Applying vector quantization to reinforcement learning

Loading...
Thumbnail Image
Identifiers
ISSN: 0302-9743 (Print)
ISSN: 1611-3349 (Online)
ISBN: 978-3-540-41043-0
Publication date
2000
Defense date
Advisors
Tutors
Journal Title
Journal ISSN
Volume Title
Publisher
Springer
Impact
Google Scholar
Export
Research Projects
Organizational Units
Journal Issue
Abstract
Reinforcement learning has proven to be a set of successful techniques for finding optimal policies on uncertain and/or dynamic domains, such as the RoboCup. One of the problems on using such techniques appears with large state and action spaces, as it is the case of input information coming from the Robosoccer simulator. In this paper, we describe a new mechanism for solving the states generalization problem in reinforcement learning algorithms. This clustering mechanism is based on the vector quantization technique for signal analog-to-digital conversion and compression, and on the Generalized Lloyd Algorithm for the design of vector quantizers. Furthermore, we present the VQQL model, that integrates Q-Learning as reinforcement learning technique and vector quantization as state generalization technique. We show some results on applying this model to learning the interception task skill for Robosoccer agents.
Description
Proceeding of: RoboCup-99: Robot Soccer World Cup III, July 27 to August 6, 1999, Stockholm, Sweden
Keywords
Bibliographic citation
RoboCup-99: Robot Soccer World Cup III, Springer-Verlag, Stockholm (Sweden), 2000, p. 49-57