Validation of the Role of Attention Mechanism in Predicting Brain Activity

Abstract

We observe the brain activity of human subjects when they are exposed to image stimuli using fMRI. We extract feature maps of the same images using Attention Branch Network (ABN) and construct a regression model that captures the correspondence between the enhanced image features and the brain activity data. This regression model will be used to examine how weighting features by ABN rather than image features extracted by CNN works in estimating the brain activity state.