Implementation of Virtual Camera Work Including Switching for Videos

Abstract

This paper propose a virtual camera-work method for musical instruments performance videos. At the concerts for professional musical instruments performers, videos are shot and edited by a professional cameraman or editors. These videos are broad-casted on TV or sold as a DVD. On the other hand, at the concerts for amateur musical instruments performers including extracurricular activities, it is difficult to have a professional cameraman or editor shoot and edit videos because of the cost problem. We can solve the cost problem by automatically reconstructing the concerts videos by fixed camera without cameraman. We have proposed a method of virtual camera-work method using receding horizon strategy which is well used in control engineering. This method eliminates the need for a professional cameraman and editor, then we can reduce the cost of shooting and editing. In this paper, we show a method to automatically reconstruct videos for musical instruments performance videos taken by fixed point camera. In case of musical instruments performance videos or concert videos, drastic changing of frame is required because various focus point (such as various performers) are including the entire frame of the fixed camera. The control objective in this paper is to propose an automatically reconstruction method of videos using receding horizon strategy with adequate setting of the cost function to achieve drastic changing the frames in reconstructed videos.