“Surprise” Neurons in the Supplementary Eye Field of the Cerebral Cortex and Exploration-exploitation Trade-off

Abstract

Exploration-exploitation trade-off is one of the big problems in reinforcement learning. Our recent study suggested that “surprise” neurons in the supplementary eye field of the cerebral cortex are involved in switching between exploratory and exploitive modes of oculomotor behavior.