Journal of Music Perception and Cognition
Online ISSN : 2434-737X
Print ISSN : 1342-856X
Comparison of the process for creating perceived congruence between a moving picture and sound based on synchronization of auditory and visual accents and that based on similarity of auditory and visual affective impressions
Saki FUJIYAMA Fumiyuki TAKISHITAToru YAHAGIShin-ichiro IWAMIYA
Author information
JOURNAL FREE ACCESS

2014 Volume 20 Issue 1 Pages 3-14

Details
Abstract
A continuous-rating experiment of congruence between a moving picture and sound was conducted to compare creating process of perceived congruence based on formal congruency and that based on semantic congruency; the formal congruency was created by the synchronization of auditory and visual accents and the semantic congruency was evoked by the similarity of auditory and visual affective impressions. The duration for creating perceived congruence based on formal congruency was shorter than that based on semantic congruency. In the case of semantic congruency, because the congruence was created after perceiving auditory and visual affective impressions and then judging the similarity between them, longer duration was necessary for perceiving congruence between a moving picture and sound. Furthermore, although synchronization of auditory and visual accents was broken, participants in the experiment tended to find formal congruency, and the perceived congruence thus rapidly fluctuated.
Content from these authors
© 2014 The Japanese Society for Music Perception and Cognition
Next article
feedback
Top