Image-Based Virtual Studio using Ultra High-Definition Omnidirectional Images

Abstract

To create a virtual studio that can generate highly realistic images in real time, we are developing technology that aims at creating a virtual studio based on image components from real pictures. The image components are divided to an environmental image component for long distant view and a three-dimensional image component for short distant view. We developed a principal-point alignment camera head for composing camera images into a high-resolution omnidirectional image as the environmental image component. We constructed an omnidirectional image (8000×8000 pixels) from about 1000 camera images and composed them into a complete view image seamlessly. We experimentally developed an HDTV image-based virtual studio with these image components and proved its usefulness for HDTV program production.