Altering Perception of Shape by the Hand Image Replacement

Abstract

In our research, we aim to construct a perception-based visuo-haptic shape display system that can provide users with the sensation of touching virtual objects of varying shapes, using cross-modal effects. In this paper, we focus on modifying the identification of a shape of a curved surface and an angle of edges when touching it with a pointing finger, by displacing the visual representation of the user's hand. We compose a video see-through system through which we can change the shapes of objects the user is visually touching, and displace the visual representation of the user's hand as if he were touching the visual shape although in actuality he is touching another shape. Our experimental results show that over 80% of the participants answered that they perceived the virtual object's shape to be different from the actual shape they touched for curved surface of shape, and the perceived angles of edges could be modified if the difference of angles between edges is in the range of -35° to 30°. These result proves the possibility for constructing a novel visuo-haptic system.