Design and implementation of ubiquitous Q-learning engine

Abstract

In this paper, we propose a ubiquitous Q-learning engine realized by a small-sized microcomputer. In order to reduce the convergence time of Q-learning, we introduce a user's instruction learning mechanism into the engine. As a practical application of the engine, we have developed a fan control device that is fixed on user's clothes and makes a confortable environment for user.