Neurodynamics of emotional judgments in multimodal stimuli

Abstract

The purpose of this study is to clarify multi-modal brain processing in human emotions. This study aimed to induce complicated emotional system of the brain by multi-modal stimuli, and to examine whether such emotional stimuli could induce consistent changes in EEG signals. We examined by auditory, visual, or combined audio-visual stimuli. Emotion of voice’s stimuli consisted of three different intonations (Angry - A, Happy - H or Neutral - N). Visual stimuli were used some photograph in faces of women expressing the same emotional valences (A, H or N). Audio-visual stimuli were composed using either congruent combinations of faces and voices (e.g. H x H) or non-congruent (e.g. A x H). The data was collected with EEG system. We compared the conditions stimuli (A or H) vs. control (N), and congruent vs. non-congruent. Topographic maps of EEG power differed between each combination stimuli.