Generating grounding graphs based on the spatial semantics description of natural language to realize the interactive operation of autonomous cars

Abstract

Recently, activities for practical application of automatic drivinghave been rapidly progressing. In the future, it is considered necessary to enable interactive operation by natural language in order to easily operate autonomous cars.Therefore, in this research, we attempt to realize the correspondence relationship, i.e., grounding, between the driving instructions expressed in natural language and the objects in the real world recognized by the sensors attached to a car, and then convert the driving instructions into the particular spatial meaning description to operate the autonomous car. In this study, we particularly focus on the parking operation of the car.