Development of an interactive navigation system based on household ontology and commonsense reasoning

Abstract

In recent years, researchers from the fields of computer vision, language, graphics, and robotics have tackled Embodied AI research. Embodied AI can learn through interaction with the real world and 3D environments and can perform various tasks in 3D environments using virtual robots. However, many of these are one-way tasks in which the interaction is interrupted only by answering questions or requests to the user. In this study, we aim to develop a task-oriented interactive system using 3D household ontology and commonsense reasoning, in which a virtual robot can reason about the location of a guide while interacting with the user and guide the user around the house.