High Fidelity Visualization Algorithm and 3D Editing System for 3D Video

Abstract

3D video is the ultimate medium for recording images of a dynamic visual event in the real world. The recorded behaviors of objects can be observed from any viewpoint, because 3D video records whole 3D shape, motion, and precise surface properties (i.e. color and texture) of objects.In our last paper, we presented a method of reconstructing the shape of a dynamic 3D object from multi-view video images, which enables a temporal series of 3D voxel representations of an object's behavior to be obtained in real-time. In this paper, we present (1) an algorithm for generating texture on the surface of a 3D object from multi-view video images, and (2) an editing system for visualizing 3D video with an omnidirectional background image using a versatile 3D camera action. This paper focuses on how we can generate high fidelity object images from arbitrary viewpoints based on 3D object shapes of limited accuracy. We propose a novel texture-mapping algorithm, which maps textures onto the surface of 3D object depending on the specific viewpoint. Experimental results demonstrate, the effectiveness of the algorithm in generating high fidelity images of objects from arbitrary viewpoints.