IEICE Transactions on Information and Systems
Online ISSN : 1745-1361
Print ISSN : 0916-8532
Regular Section
Multi-Task Approach to Reinforcement Learning for Factored-State Markov Decision Problems
Jaak SIMMMasashi SUGIYAMAHirotaka HACHIYA
Author information
JOURNALS FREE ACCESS

Volume E95.D (2012) Issue 10 Pages 2426-2437

Details
Download PDF (522K) Contact us
Abstract

Reinforcement learning (RL) is a flexible framework for learning a decision rule in an unknown environment. However, a large number of samples are often required for finding a useful decision rule. To mitigate this problem, the concept of transfer learning has been employed to utilize knowledge obtained from similar RL tasks. However, most approaches developed so far are useful only in low-dimensional settings. In this paper, we propose a novel transfer learning idea that targets problems with high-dimensional states. Our idea is to transfer knowledge between state factors (e.g., interacting objects) within a single RL task. This allows the agent to learn the system dynamics of the target RL task with fewer data samples. The effectiveness of the proposed method is demonstrated through experiments.

Information related to the author
© 2012 The Institute of Electronics, Information and Communication Engineers
Previous article Next article

Altmetrics
Recently visited articles
Journal news & Announcements
  • Please contact trans-d [a] ieice.org, if you want to unlock PDF security.
feedback
Top