Host: The Institute of Image Electronics Engineers of Japan
Co-host: The Institute of Image Information and Television Engineers
Applications with projector(s) and camera(s) will be more popular since both devices became inexpensive. We proposed a touch-screen system combined with a projector and a camera. Our system recognizes a hand and its shadow in a projected button area, and determines whether the user is touching the button by calculating the ratio of the hand and its shadow area. It’s essential to accurately recognize their areas on the video images from the camera input. In this paper, we propose a method to accurately separate the hand area and its shadow to pick up their pixel values in the system initialization. According to the color distribution of hand and its shadow in the initialization, likelihood of hand and shadow for the pixels in the button area are determined. By using the ratio of the amount of shadow likelihood and hand likelihood of those pixels, we can achieve stable touch detection and button drag.