Development of Games Using Avatar Communication and Brain Waves

Abstract

  As the next technology for the Metaverse, we are attempting to (1) approach reality using robots and drones, and (2) construct an ideal virtual space using biofeedback. As an effort to realize (1), we created avatar robots and avatar drones and demonstrated that they could be remotely controlled from the Metaverse across countries. Although there is still room for improvement, such as technical issues and production improvements, this is a first step in approaching reality from the Metaverse. We are also attempting to implement avatar robots in society by holding a sports day using avatar robots called the Avatar Challenge. As an effort to achieve (2), we introduce a method to create a virtual space that is as realistic as possible for the person, using biofeedback such as brain waves. A VR head-mounted display called Galea that integrates biosensors such as brain waves has also been released and is expected to satisfy gamers who are looking forward to a full dive.

  With the rapid development of LLMs such as ChatGPT, the adoption of AI in robots and drones is accelerating. It is thought that as an extension of these, there will be a close fusion of cyberspace and physical space, and the relationship with the metaverse will also be reconsidered. At this time, it may be possible to realize the physical sensation (?) of robots and drones using biofeedback. I hope that this field will expand into a wide range of fields.