The multi-fingered robot hand has much attention in various fields. Many Robot hands have been proposed so far. A teleoperation system for the hand/arm robot allows intuitive manipulation of the hand/arm robot. Therefore, this paper deals with a motion capture system for controlling the hand/arm robot remotely. Here, we use inertial measurement units in order to detect the joint angle of an operator's hand and arm.