Viewpoint Dependent Color Manipulation Based on Reflection Property using Optical Feedback with Multiple Projector-Camera Systems

Abstract

In this paper, we propose a light-field feedback system that realizes the appearance manipulation depending on the viewing direction. The proposed method employs a reflection model for the multiple projectors and multiple cameras, and our pseudo inverse for MIMO (multiple input, multiple output) system enables stable light-field feedback. Through the experiments, we confirmed that the system allowed appearance manipulation not only on the mirror reflection but also retro-reflection surface that cannot accomplish without light-field feedback. Besides, we confirmed our method achieved robust appearance manipulation against disturbances such as ambient light change.