Visual Localization of On-Vehicle Videos on the WEB using Space and Time Feature Matching

Abstract

Recently, a number of researches are conducted to construct the actual city into computers for the purpose of web services, ITS, disaster analysis, landscape simulations and so on. Further, with the spread of on-vehicle video cameras, it becomes common to share the on-vehicle video on website. If locations of the videos are available, the data can be efficiently used for virtual city construction. In this paper, we propose a method to realize localization of anonymous on-vehicle videos uploaded on the web by using video matching technique with Temporal Height Image (THI), Affine SIFT and Bag of Feature (BoF). THI retains information of relative building heights from temporal image sequences and the Affine SIFT realizes a robust matching for variance of both camera speed and driving lane. Finally, BoF representation allows us to realize a stable matching with less computational cost. We conducted several experiments using real image sequences of the actual city to show the successful results of the proposed method.