Research on drawing projection mapping

Abstract

Projection mapping is a technology that projects movies onto 3D objects in the real world using computer-generated animations such as computer graphics and some projection equipment, sometimes synchronized with sound. We thought that if we could project CG images so that user drawing is immediately scanned and becomes three-dimensional in drawing, the user will feel as if they are drawing a 3D picture themselves even though they are only drawing on a flat surface, and they will be able to have a more intuitive and brand-new experience as either projection mapping or drawing. In this experiment, the pictures drawn on the whiteboard were subjected to image processing and 3D CG processing, and projected using a projector to check whether they were processed and projected correctly. We discuss the solution to the problem that arose during the experiment, where the projected light changed the color of the user drawing image to be read and the second and subsequent projection processes are not processed correctly, the implementation, and the evaluation.