Design and Preliminary Evaluation of High Speed Line-of-Sight Calculation CMOS Image Sensor

Abstract

Line-of-sight (LoS) calculation, or detecting where the user is looking at, is expected as a new type of user interfaces, with including the phenomenon of rapid eye movement, so called saccade. However, real-time tracking of saccade is difficult with the conventional image processing systems for their long processing time and latency against the speed of saccade. In this paper, we describe the design of the high speed, low latency LoS calculation image sensor, as well as its preliminary evaluation results. This image sensor has a capability to track the saccade at high frame rate, and generate the LoS calculation results with minimum latency for real-time tracking.