Abstract
Many researchers who research stochastic simulations such as reinforcement learning algorithms have to run their programs many times to compare developing algorithms and find better sets of parameters for their programs. In order to reduce their working time, we build a problem solving environments (PSE) system to assist them. Our system has three sub-systems: a distributed computing system, a data management system and a graph generation system. We present a relationship between developing algorithms and the three sub-systems. Users automatically obtain results and compare them graphically using the system after they register their own programs in the system. We conduct experiments with human subjects. As a result, user obtained five times speed-up for his work time through executions, storing results and comparing algorithms.
