A Multimodal Gestural Drawing Interface

Using the mouth to control stylus input

Abstract

In this paper we introduce a novel vision-based interface which captures gestures of the user's mouth and uses these together with a pen and tablet interface for multimodal control of drawing and painting. With small motions of the mouth the user can control pen attributes such as line thickness, hardness, ink colour and so on. Simultaneous control of mouth and hand gestures is relatively facile, so we have found that it is not difficult for an artist to learn how to use the new interface. so we have found that it is not difficult for an artist to learn how to use the new interface.