Comparison of Active Areas by Estimating Brain Activities evoked by Verbal Stimuli given from Speech and Text

Abstract

To investigate the semantic representation of the state in the brain evoked by verbal stimuli, we aim to estimate the state in the brain under two conditions based on the verbal stimuli. The first is estimated by regressing the brain state from BERT embedding vectors built by text converted through voice transcription. The second is to compare the difference between auditory and visual senses for semantic processing – we estimated brain activities, when the subject was reading voice transcription texts and reading the texts silently. In the two conditions, we have observed a remarkable reaction in superior temporal gyrus and inferior frontal gyrus, which are responsible for language processing, such as the Wernicke’s area (sensory language center) and Broca’s area (motor language center).