Constructing Knowledge Graphs of Daily Activities using 3D Virtual Spaces

Abstract

Most of the daily living studies require cameras, sensor networks, and experimental space, and it is not easy to collect data by flexibly changing the conditions. In the future, for analysis of daily life, it is necessary to combine data obtained from both a physical environment that can acquire real data and a virtual environment that can flexibly change conditions and perform a large number of experiments. Moreover, in addition to recognizing activities from the collected data, it becomes possible to analyze daily living activities at the semantic level by adding abstract and background knowledge. In this study, we propose a method to construct knowledge graphs based on the simulation results of daily living using virtual space, in order to enable various analyzes of activities of daily living. First, we constructed an ontology representing activities and situations in virtual space, then constructed knowledge graphs of the daily living simulation results based on the ontology. Moreover, we proposed a method for knowledge graph augmentation by combining multiple activity graphs. This paper also discusses the knowledge graph generation method, proposed ontology, and potential for expansion.