Grounding natural language to the real world to realize the interactive operation of autonomous cars

Abstract

Recently, practical applications of automatic driving have been rapidly developing. In the future, it must be necessary to enable interactive operation by natural language in order to easily operate autonomous cars. We therefore attempt to realize the correspondence relationship, i.e., grounding, between the driving instructions expressed in natural language and the objects in the real world recognized by the sensors equipped with a car, and then convert the driving instructions into the particular spatial meaning description to operate autonomous cars. In this study, we particularly focus on the parking operation of the car.