Development of New BrushDevice Augmenting the Feeling of Painting on Virtual Objects

Abstract

We have developed a mixed reality (MR) painting system called the MR-based Artistic Interactive (MAI) Painting Expert, which simulates painting of physical objects in the real world. This system includes an interaction device called MAI Painting Brush, which has the characteristics of an actual paintbrush, and a painting model developed using this device. However, this system could not give the feeling of painting on virtual objects in an MR space. Therefore, we proposed and developed mechanisms that simulate the effect of touch and move when a brush device is used with a virtual painting target. In this paper, four mechanisms were proposed; the bend, slider, belt, and flap mechanisms, to provide the feeling of touching and painting a virtual object with the brush device, using visual and tactile feedback. These mechanisms were implemented and tested as prototypes, and a new brush device named MAI Painting Brush++ was designed and developed based on the result.