Motion Estimation Using Distortion Planes of pixel-wise Matching

Abstract

We propose a novel framework for motion estimation based on pixel-wise matching. The proposed system consists of two steps. First, a distortion plane, which is a function of the displaced-frame difference of a single pixel, is determined and stored for each pixel. Second, motion is estimated based on a criterion which employs an operator working on the obtained distortion planes. The motion vector that gives the minimum (or maximum) value for the criterion is then estimated. The new framework is flexible in allowing selection of various motion models and operators. In this paper, we focus on a nonlinear weighted-summation operator and a majority-decision operator, in order to deal with discontinuities in the motion field. We also discuss a Hough-transform operator for an affine motion model. Experimental results show that the proposed methods allow us to estimate motion with high accuracy.