Multi-Layered Dynamic Background Buffering for Effective Free Viewpoint Video Synthesizing

Abstract

Reference images with their depth maps are often used as materials for free viewpoint images. However, occlusion can degrade the quality of the output images. To solve this problem, we developed an effective synthesizing method using multi-layered background buffers that increases the quality of free viewpoint images. Since the buffers are created and updated dynamically without additional information such as separate background images, the method is applicable to conventional materials. The effectiveness of the proposed method was shown by several simulation experiments.