An Automatic Video Creation System for Music Considering Chorus Section

Abstract

An effective combination of music and video images generates efficacious interaction between auditory and visual processing. Then, these techniques are used at concert halls, on promotional videos, or on TV commercials. However, the professional knowledge and/or tools are necessary to create video images considering the interaction between auditory and visual processing. From this kind of circumstances, we have proposed a method to create a video image well-suited to the music based on its characteristics automatically. However, the peak such as chorus section of the music has not been taken into account in the method. Then, in this study we tried to create a video better-suited to the music by extracting chorus section based on both the music activation level that is obtained by using the root mean square of the volume of the low-tone and the high-tone and the skewness of the middle-tone. The results of the verification experiment show the effectiveness of the method.