Host: The Japan Society of Mechanical Engineers
Name : [in Japanese]
Date : June 28, 2023 - July 01, 2023
We propose a system that enables 3D movement of a pointer in the Mixed-Reality space without fatigue by fixing the forearm and moving the fingertip. This system uses depth cameras to sense the shape of the hand and maps the center of the index finger to the pointer in the 3D space. Then, by moving the fingertip, the 3D image on the head-mounted display is updated and the position of the pointer can be changed. Furthermore, experiments have shown that the accuracy and speed of pointer manipulation can be improved by non-contact ultrasonic tactile presentation to the fingertip according to the positional relationship between the destination and the pointer.
