An Approach to Automatic Motion Synthesis Harmonized with Music for Multiple Objects

Abstract

This paper proposed a research approach to automatic choreography synthesis based on SMF(Standard Midi File) for multiple animated figures. Based on the K.Hevner’s theory, 8 types of emotion in each beat can be extracted from music structure elements, such as tempo, key, rythm, melody, harmony, pitch, which can be computed from SMF. The time of one beat is limited to transmit the emotion to human. By the analysis of emotion, a music can be integrated to several time intervals, every which includes several continuous beats. The top value of synthetic emotion vector represents the emotion type of the interval. Based on the experiment result of C.Matsumoto, 14 motion factors can be mapped from the emotion of interval.
According to the 14 motion factors, the macro-motions at the terminals of every interval, and the micromotions between every interval can be generated by mapping rules. We made a prototype system and did a subjective evaluation experiment. The result is fairly good at the congruity between generated motions and given emotion music. A successful research to solve these issues should lead to aid the designation of 3DCG animation.