The direction of the user's eye attention, or line of sight, has been widely discussed on its applications for new types of user intafaces, however, currently its applications are restricted in the special purposes, for expensive detection system and difficulty in operation. In addition, Saccade, the very rapid eye motion, has been expected to be an explorer for novel types of user interfaces, however, it is impossible to detect and track Saccade motion using conventional camera system. The authors have been proposed the vision architecture for detecting line of sight includiing saccade. In this paper, we describe the fast real-time eye-tracking system with implemented architecture of vision chip on FPGA with high speed camera, as well as its evaluation.