Abstract
In recent years, there are a variety of information technology tools, like personal computers, mobile phones, and car navigations, in the world. These tools have specific interface. It is difficult for us to understand intuitively how to use. So we aim to natural interaction between human and system. Therefore, with joint visual attention, a system focuses attention to the same thing with a human being, and we get joint understanding. For that, we constructed nonverbal interface by using human natural motion. In this study, we focused on using pointing behavior for a natural motion interface. The experiments, the user pointed out a specific parking space. The system recognize that the user want to park a car there. And the system tries to park a car automatically. Furthermore, we intend to make use of this study in RT middleware.