2016 年 23 巻 1 号 p. 41-45
Exploration-exploitation trade-off is one of the big problems in reinforcement learning. Our recent study suggested that “surprise” neurons in the supplementary eye field of the cerebral cortex are involved in switching between exploratory and exploitive modes of oculomotor behavior.