Synthesizing Fixed Point-of-Views for Omnidirectional Camera Ball

Abstract

In this paper, we proposed a method to fix the point of views (POVs) of equirectangular format videos, which is captured by omnidirectional cameras embedded in a ball, to an arbitral direction even if the ball is rotating. Feature points are extracted from an entire omnidirectional image and the camera's pose is estimated by feature matching and the 5-point algorithm. The POV of the current frame is modified to the one of the initial frame by applying the product of estimated rotation matrices between all of adjacent frames up to the current. The proposed method is not limited to our ball prototypes and can be applied to any omnidirectional videos taken with different camera systems.