Proceedings of the Annual Conference of JSAI
Online ISSN : 2758-7347
34th (2020)
Session ID : 4B3-GS-1-04
Conference information

Automatic adjustment of decay factor in Tree Reuse MCTS
*Kota YOKOGAWAKoichi MORIYAMAAtsuko MUTOHTohgoroh MATSUINobuhiro INUZUKA
Author information
CONFERENCE PROCEEDINGS FREE ACCESS

Details
Abstract

MCTS is a best-first search algorithm that gradually expands a search tree based on the results of random searches. One of its extensions is called "Tree Reuse". It stops repetitive searches by leaving a subtree from a child node that will be the root node next. However, it causes a problem in a non-deterministic environment where same choices give different results. It is often alleviated by attenuating the information the subtree has, but it is difficult to know in advance the attenuation level, called a decay factor, appropriate in the environment. Therefore, this work proposes a method automatically adjusting the decay factor using information obtained from the environment. Experiments using multiple game environments show that the proposal is better than the conventional Tree Reuse MCTS in the finish rate of the games.

Content from these authors
© 2020 The Japanese Society for Artificial Intelligence
Previous article Next article
feedback
Top