Abstract
In this study, we developed Interactive Puppet Theater. Interactive Puppet Theater is a puppet show system that is designed for appreciation by hearing-impaired people. This system has two features to allow the hearingimpaired people to enjoy a puppet show. First, to ensure that aural information is conveyed, we project the dialogues (textual data) onto the background of the puppet show. Then, using Kinect, we allow the audience to participate in the story through physical movements. Thus, the audience is allowed to influence the story’s progression. Similar to gestures and sign language, physical movement is a relatively easy way for the hearing-impaired people to express themselves. Therefore, we aimed to create a system that would make it relatively easy for them to facilitate the progression of the story using means that they are most familiar with. We believe that these features will assist the hearingimpaired people in enjoying a puppet show.
