Action Control of Autonomous Agents in Continuous Valued Space Using RFCN

Abstract

Researches on action control of autonomous agents and multiple agents have attracted increasing attentions in recent years. The general method using action control of agents are neural network, genetic programming and reinforcement learning. In this study, we use neural network for action control of autonomous agents. Our method determines the structure and parameter of neural network in evolution. We proposed Flexibly Connected Neural Network (FCN) previously as a method of constructing arbitrary neural networks with optimized structures and parameters to solve unknown problems. FCN was applied to action control of an autonomous agent and showed experimentally that it is effective for perceptual aliasing problems. All of the experiments of FCN, however, are in only grid space. In this paper, we propose a new method based on FCN which can decide correct action in real and continuous valued space. The proposed method which called Real valued FCN (RFCN) optimizes input-output functions of each units, parameters of the input-output functions and speed of each units. In order to examine the effectiveness, we applied the proposed method to action control of an autonomous agent to solve continuous valued maze problems.