Development of a Book Interface using Data Projector

Abstract

In this paper, we develop the book interface by using techniques of augmented reality. This system consists of the following processes: In the process of calibration, we calibrate the projector coordinate system, the image coordinate system and the world coordinate system. In the process of geometric correction, as the projection surface (the book screen) is a non-plane, we acquire 3-D data on the surface of this book screen based on multibaseline stereo method. Then, in order to correct geometry of image, geometric information are calculated from calibration parameter and acquired 3-D data on the surface of this book screen. In the process of page recognition, page number of the book screen is recognized by using bar code and CCD camera. In the process of image display, a book image is selected according to the recognized page number, and corrected image is generated by using the geometric information. Then, the corrected image is projected onto the book screen. Finally, we display old book images by using this system, and have confirmed its effectiveness.