We propose a smart sensor which has two focal planes on one chip. This sensor produces 1bit flag signals which indicate the position of moving area. And by using only this flag signals, tracking of moving object and estimation of the depth can be done in real time. In this paper, we describe the simulation results by using FPGA and two smart sensors, and the circuit design of the new smart sensor.