Spatial Domain Definition of Focus Measurement Method for Light Field Rendering and Its Application for Images Captured with Unstructured Array of Cameras

Abstract

We developed a novel image-based rendering method that uses inputs from unstructured cameras and synthesizes free-viewpoint images of high quality. Our method uses a set of depth layers to deal with scenes with large depth ranges. To each pixel on the synthesized image, the optimal depth layer is assigned automatically based on our on-the-fly focus measurement algorithm. This method is a modified version of our prior work with another definition of the algorithm in the spatial domain, which enables us to extend the application scope for images captured by an unstructured array of cameras. We implemented the proposed method and achieved nearly interactive frame-rates on a commodity PC.