Visualizion and Control of Command Spaces for a Gesture-based Device Operation System via Hololens

Abstract

In a previous study, a multi-camera system was constructed to operate home appliances using only gestures. However, this system required time for the user to become accustomed to its operation. In this paper, we propose a system that visualizes and further enhances the previous system by using Mixed-Reality Goggles to visualize and control the command spaces. Experiments were conducted to evaluate the usefulness of the proposed system, and it was confirmed that the system was useful to acclaimatize operation methods.