Re-Design and Implementation of MR-based Filmmaking System by Adding Diminished Reality Functions

Abstract

In this paper, we propose DR-PreVis system as an expansion of the previous work, MR-PreViz. MR-PreViz is a mixed reality-based PreVis system that can superimpose CG animated characters to real backgrounds such as open sets or outdoor locations. The proposed system not only uses the real backgrounds but also diminishes undesirable objects in the real backgrounds by using diminished reality (DR) technologies. We re-designed the concept and the workflow of MR to accommodate DR technologies. We rationally selected and implemented several DR methods and camera tracking methods to apply our DR-PreVis system to various scenarios in the film industry. We also implemented color correction schemes that could handle dynamic illumination changes, especially in outdoor scenarios. Finally, we tested the proposed system in an indoor set and also in the outdoor open sets to verify the usefulness of our system.