A Preliminary Study of Kinect-Based Real-Time Hand Gesture Interaction Systems for Touchless Visualizations of Hepatic Structures in Surgery

抄録

We present a real-time hand gesture interaction system for the touchless visualization of hepatic structure in surgery, for which real-time visualization is important, particularly, during operations, but often faces the challenge of efficiently reviewing a 3D model of a patient's anatomy without requiring the surgeon to touch an input device, such as a mouse or keyboard, to maintain a sterile field. To solve this problem, we developed a touchless system based on hand gesture interaction. We used a Microsoft Kinect sensor as an input device, which performs hand detection and tracking. Our approach combines three kinds of hand states and their movements to control the visualizations of hepatic structures. Experiments demonstrate that our system can realize real-time hand gesture interactions and visualizations.