Eye direction measurement is expected to have wide application area, including user interface and psychological analysis. The saccade, a rapid eye motion, is also expected to be applicable for a new type of interaction technique, however, it is impossible to measure and track the saccade in real-time by using the conventional eye direction measurement system. In this paper, we describe the high frame, 500[Hz], and low processing latency eye tracking camera system using high speed camera and FPGA, are described. We also discuss on the saccade destination prediction algorithm enabling to predict the saccade destination at early step of saccade, before the saccade ends.