Host: The Japan Society of Mechanical Engineers
Name : [in Japanese]
Date : June 28, 2023 - July 01, 2023
This research addresses the growing demand for a modular-based system that enables development in users’ environments, considering security concerns and implementation costs. The study presents a modular approach using the NEP communication library, specifically designed to easily integrate different robotics systems, to enhance gesture-based interaction in remote-controlled humanoid robots in open environments like meeting rooms. The implemented system employs a single camera setup and recognizes upper body gestures, utilizing a Vector robot, a computer with sufficient processing power, and the NEP library for module communication. The modules include environment interaction, person detection, pose recognition, and gesture recognition. Results show a three times increase in frame rate when switching from pipeline to NEP processing and a 20% increase in latency. In conclusion, the modular system using the NEP library successfully improves gesture-based interaction, opening up possibilities for further development and customization in users’ environments.
