The composite images in virtual studios as used by broadcast stations require that unnatural sensations be minimized real time characteristics be maintained. If the lighting conditions of captured images do not match those of computer graphics (CG), however, the composite image will appear unnatural to viewers. In response to this problem, we used projectors to reproduce the CG lighting environment in real space with the aim of reducing this unnatural feeling caused by unmatched lighting conditions. At the same time, chroma keying, the conventional video composite technique, does not allow for the setting of any lighting conditions on the real space side, thereby preventing the proposed light big reproduction technique from being applied to a virtual studio. For this reason, we developed a new video composite technique. The technique that uses transmission retro reflective material, an infrared camera placed at a conjugate position with respect to a color camera, and infrared lighting to remove the constraint conditions associated with the chroma key technique. In this paper, we formally propose this new technique and demonstrate its effectiveness.
