Hand detection in consideration of the frame-out of hand for first person viewpoint sign language recognition

Abstract

A main of this study is to develop a sign language recognition system in a first person view framework for a smooth communication tool between a hearing-impaired person and a normal hearer. As an intrinsic issue in the first person view framework, it is required to deal with frame-out of hands arising from a closeness between a camera and hands. A detection of frame-outs by skin color extraction methods, which are commonly used as a hand detection, doesn’t work well. This is because it is difficult to discriminate a hiding of hand due to another hand from a frame-out of one hand. That is why it is required to develop a method to distinguish those. In this paper, a method to distinguish the hand hiding from the hand frame-out is proposed, and then some experimental results are demonstrated.