When using video chat, you may send private information to other party with background information (e.g, inside office) of the video that is not processing. To cope with this problem, it is effective to replace background information excluding an object with any image according to the purpose. In addition, the background replacement that replaces video background with a landscape image can do video chat with “Feeling like you are at the location shown in the image”. However, if it applies the background replacement to the video chat, uncomfortable feeling will be caused by the chroma difference between a human region of camera image and a new background image (e.g, a landscape image). This chroma difference can be caused by the difference of color temperature of the light source when capturing images. In this paper, we proposed a method of the uncomfortable feeling reduction of background replacement on the basis of features of color temperature.
The algorithm comprises three steps. First, it initialized parameters of the adaptive background subtraction, which is a method to extract human region from camera image as a pre-process phase. It also generated a matrix for the chromatic adaptation transform (CAT) with the color temperature estimated from the camera image and a new background image. Next, the human region was extracted from the camera image by the background subtraction, and it applied the CAT to this region. Finally, it extracted the background region from the new background image using the background subtraction result. Moreover, it obtained the background replacement results as a logical sum of the result by the CAT and the background region.
The results of experiment conducted with 14 evaluators for analyzing images suggest that the proposed method can reduce uncomfortable feeling of background replacement.
View full abstract