In order to perform drawing activities smoothly in the real world, it is necessary to chage line color or width by intuitional manipulation. On the other hand, in the drawing based on Augmented Reality technique, it is difficult that they had to be changed using GUI. This paper describes the direct manipulate interface to be able to capture and utilize the visual information around the user as a painting material. Then we developed the fully immersive 3D drawing system which embeded this interface consist of CCD camera assumed as vision, and confirmed the effectiveness of that.