Abstract
In television programs and movies, various switching patterns are used for changing scenes. We conducted a rating experiment to examine the impression made by various audio-visual combinations to clarify the effects of various combinations of switching patterns and sound effects. Sound stimuli consisting of continuous scale patterns (which produce a bright impression) match all kinds of switching patterns. In particular, the ascending scale pattern matches enlarging image, in which a new image expands from the center of the screen. In contrast, the descending scale matches the reducing image, in which the original image is eroded by the new image and is reduced in scale. The obtained congruency between sounds and switching patterns is based on the structural congruency of image pattern and pitch pattern: such as ascending pitch and enlarging image, or descending pitch and reducing image. Furthermore, when the congruency between sound and motion picture is high, evaluation of the audio-visual product is also high. This tendency is based on the cooperative interaction between auditory and visual processing. Sounds and motion pictures should be integrated into a single perceptual unit having a single function in order to produce an impressive effect.
