通信ライブラリを活用した低スペックロボットによる複数人環境下での個人およびジェスチャーの認識

抄録

This research addresses the growing demand for a modular-based system that enables development in users’ environments, considering security concerns and implementation costs. The study presents a modular approach using the NEP communication library, specifically designed to easily integrate different robotics systems, to enhance gesture-based interaction in remote-controlled humanoid robots in open environments like meeting rooms. The implemented system employs a single camera setup and recognizes upper body gestures, utilizing a Vector robot, a computer with sufficient processing power, and the NEP library for module communication. The modules include environment interaction, person detection, pose recognition, and gesture recognition. Results show a three times increase in frame rate when switching from pipeline to NEP processing and a 20% increase in latency. In conclusion, the modular system using the NEP library successfully improves gesture-based interaction, opening up possibilities for further development and customization in users’ environments.