An Automatic Video Creation Method for Music Considering the Tempo and the Impression of the Music

Abstract

An effective combination of music and a video image generates efficacious interaction between auditory and visual processing. Then, these techniques are used in concert halls, on promotional videos, or on TV commercials. However, the professional knowledge and/or tools are necessary to create video images considering the interaction between auditory and visual processing. From this kind of backgrounds, we have proposed a method to create a video image well-suited to the music based on its characteristics and chorus section detection automatically. However, the tempo and the impression of the music has not been taken into account in the previously proposed method. Then, in this study, we propose a method to create a video better-suited to a given music by considering the tempo and the impression extracted from the music. The results of the verification experiment show the effectiveness of the proposed method.