Synchronization of Screen Images and Sound: The Basis and Application of the Principle of the “Picture Leading Sound”

Abstract

The principle of the “picture leading sound” is widely applied in animation production with regard to the synchronization of screen images and audio inputs, it is believed that the final product is superior when the picture leads the sound by two frames. For example, Disney’s short animation movie series “The Silly Symphony” was produced for 10 years from 1929, and initially, the rule of maintaining the unity of moving pictures and music was followed. However, computer analyses confirm that with time, pictures began leading the sounds. While the principle of the “picture leading sound” is simply a rule of thumb for filmmakers, and the scientific rationale for this practical standard has not yet been sufficiently investigated. It is said that human beings perceive “deviations” with screen images when their corresponding sounds are three frames or 0.1 second or more apart regardless of whether they are viewing a live- action or an animation film. Therefore, it is necessary to refer to theories of perceptual psychology to adequately understand the principle of the “picture leading sound” to develop a hypothesis about film production norms concerning stimuli reaching the human brain.

This paper aims to present a theoretical explanation for the adoption of the above manner of frame processing in filmmaking. It further intends to analyze specific examples from cinema to reveal that the method of image preceding sound brings about artistic dynamism in all motion pictures and not in animated films alone.