Target Region Prediction from Navigation Instructions in Urban Areas

Abstract

In this work, we propose a Trimodal Navigable Region Segmentation Model (TNRSM), which can handle three modalities: image, navigation instruction, and semantic segmentation masks. We validated our model on the Talk2Car-Regseg dataset. The results demonstrated that our method outperformed the baseline method in all evaluation metrics in the Referring Navigable Regions task.